Apr 20 18:33:15 devstack cinder-volume[72643]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 18:33:15 devstack cinder-volume[72643]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 18:33:15 devstack cinder-volume[72643]: we strongly recommend against using it for new projects.
Apr 20 18:33:15 devstack cinder-volume[72643]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 18:33:15 devstack cinder-volume[72643]: framework.  For more detail see
Apr 20 18:33:15 devstack cinder-volume[72643]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 18:33:15 devstack cinder-volume[72643]:   import eventlet  # noqa
Apr 20 18:33:16 devstack cinder-volume[72643]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:33:16 devstack cinder-volume[72643]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:33:16 devstack cinder-volume[72643]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO dbcounter [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Registered counter for database cinder
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_db.sqlalchemy.engines [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG dbcounter [-] [72643] Writer thread running {{(pid=72643) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.rpc [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.rpc [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_db.sqlalchemy.engines [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.volume.manager [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Determined volume DB was empty at startup.
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG cinder.volume.manager [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72643) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.volume.manager [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 20 18:33:17 devstack cinder-volume[72643]: WARNING stevedore.named [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 18:33:17 devstack cinder-volume[72643]: WARNING castellan.key_manager [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:33:17 devstack cinder-volume[72643]: WARNING cinder.keymgr.conf_key_mgr [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG cinder.volume.drivers.lvm [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72643) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_concurrency.processutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72643) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_concurrency.processutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.219s {{(pid=72643) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_db.sqlalchemy.engines [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.rpc [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.rpc [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 20 18:33:17 devstack cinder-volume[72643]: WARNING stevedore.named [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 18:33:17 devstack cinder-volume[72643]: WARNING castellan.key_manager [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO cinder.volume.manager [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_db.sqlalchemy.engines [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72643) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:33:17 devstack cinder-volume[72643]: INFO oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Starting 1 workers
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Started child 72747 {{(pid=72643) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Full set of CONF: {{(pid=72643) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] ******************************************************************************** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Configuration options gathered from: {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] ================================================================================ {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] allow_availability_zone_fallback = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] allow_compression_on_image_upload = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72747]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] allowed_direct_url_schemes     = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] api_rate_limit                 = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] auth_strategy                  = keystone {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] az_cache_duration              = 3600 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_availability_zone      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_host                   = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_name                   = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_stats_polling_interval = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backup_api_class               = cinder.backup.api.API {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backup_name_template           = backup-%s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backup_use_same_host           = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backup_use_temp_snapshot       = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] chap_password                  = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] chap_username                  =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_internal_tenant_project_id = caf93a4772f44d23875acefdc303a2bd {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_internal_tenant_user_id = 5ddb9509229341f9801238d5b64eb88d {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cloned_volume_same_az          = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cluster                        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] compression_format             = gzip {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] config_dir                     = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] config_source                  = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] control_exchange               = openstack {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] debug                          = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] default_availability_zone      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] default_group_type             = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] default_volume_type            = lvmdriver-1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] disk_geometry                  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] driver_client_cert             = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] driver_client_cert_key         = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] driver_data_namespace          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] driver_ssl_cert_path           = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] driver_ssl_cert_verify         = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] driver_use_ssl                 = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] enable_force_upload            = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] enable_new_services            = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] enable_unsupported_driver      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] enforce_multipath_for_image_xfer = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] filter_function                = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_api_insecure            = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_api_servers             = ['http://192.168.122.254/image'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_api_ssl_compression     = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_ca_certificates_file    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_certfile                = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_keyfile                 = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_num_retries             = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance_request_timeout         = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] goodness_function              = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] graceful_shutdown_timeout      = 5 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] group_api_class                = cinder.group.api.API {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] host                           = devstack {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_compress_on_upload       = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_conversion_address_space_limit = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_conversion_cpu_limit     = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_conversion_disable       = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_upload_use_cinder_backend = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_upload_use_internal_tenant = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_volume_cache_enabled     = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_volume_cache_max_count   = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] image_volume_cache_max_size_gb = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] init_host_max_objects_retrieval = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] iscsi_target_flags             =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] iscsi_write_cache              = on {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] iser_helper                    = tgtadm {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] iser_ip_address                = 192.168.122.254 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] iser_port                      = 3260 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_color                      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_config_append              = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_dir                        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_file                       = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_options                    = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_rotate_interval            = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_rotate_interval_type       = days {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] log_rotation_type              = none {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] max_age                        = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] max_logfile_count              = 30 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] max_logfile_size_mb            = 200 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] max_over_subscription_ratio    = 20.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] message_reap_interval          = 86400 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] message_ttl                    = 2592000 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] migration_create_volume_timeout_secs = 300 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] monkey_patch                   = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] monkey_patch_modules           = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] my_ip                          = 192.168.122.254 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] no_snapshot_gb_quota           = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] num_iser_scan_tries            = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] num_shell_tries                = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] num_volume_device_scan_tries   = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] nvmeof_conn_info_version       = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] nvmet_ns_id                    = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] nvmet_port_id                  = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_max_limit                = 1000 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_volume_ext_list          = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_volume_listen_port       = 8776 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_volume_use_ssl           = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] osapi_volume_workers           = 2 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] per_volume_size_limit          = -1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] periodic_fuzzy_delay           = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] periodic_interval              = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] public_endpoint                = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] publish_errors                 = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_backup_gigabytes         = 1000 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_backups                  = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_gigabytes                = 1000 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_groups                   = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_snapshots                = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] quota_volumes                  = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] rate_limit_burst               = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] rate_limit_except_level        = CRITICAL {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] rate_limit_interval            = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] reinit_driver_count            = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] replication_device             = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] report_discard_supported       = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] report_interval                = 120 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] reservation_clean_interval     = 86400 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] reservation_expire             = 86400 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] reserved_image_namespaces      = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] reserved_percentage            = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] rpc_response_timeout           = 120 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] run_external_periodic_tasks    = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] scst_target_driver             = iscsi {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] scst_target_iqn_name           = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_down_time              = 720 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] shell_completion               = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] snapshot_name_template         = snapshot-%s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] snapshot_same_host             = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] split_loggers                  = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] state_path                     = /opt/stack/data/cinder {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] storage_availability_zone      = nova {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] storage_protocol               = iSCSI {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] syslog_log_facility            = LOG_USER {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] target_helper                  = lioadm {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] target_ip_address              = 192.168.122.254 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] target_port                    = 3260 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] target_protocol                = iscsi {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] target_secondary_ip_addresses  = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] trace_flags                    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] transport_url                  = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] until_refresh                  = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_chap_auth                  = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_default_quota_class        = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_journal                    = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_json                       = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_multipath_for_image_xfer   = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_stderr                     = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] use_syslog                     = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] verify_glance_signatures       = enabled {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_api_class               = cinder.volume.api.API {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_backend_name            = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_clear                   = zero {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_clear_ionice            = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_clear_size              = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_copy_bps_limit          = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_dd_blocksize            = 1M {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_name_template           = volume-%s {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_service_inithost_offload = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volume_usage_audit_period      = month {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72747]: INFO cinder.volume.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] zoning_mode                    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_concurrency.disable_process_locking = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.admin_password = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.admin_token = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.admin_user  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_protocol = https {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_section = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_type   = password {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_uri    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.auth_version = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.cache       = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.certfile    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.identity_uri = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.include_service_catalog = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.insecure    = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.interface   = public {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.keyfile     = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_password =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcache_username =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.region_name = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.service_type = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.backend                  = dogpile.cache.null {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.backend_argument         = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.backend_expiration_time  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.config_prefix            = cache.oslo {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.debug_cache_backend      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.enable_retry_client      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.enable_socket_keepalive  = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.enabled                  = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.enforce_fips_mode        = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.expiration_time          = 600 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.hashclient_retry_attempts = 2 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_dead_retry      = 300 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_sasl_enabled    = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.password                 = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.proxies                  = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.redis_db                 = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.redis_server             = localhost:6379 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.retry_attempts           = 2 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.retry_delay              = 0.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.socket_keepalive_count   = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.socket_keepalive_idle    = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.socket_keepalive_interval = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.socket_timeout           = 1.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.tls_allowed_ciphers      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.tls_cafile               = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.tls_certfile             = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.tls_enabled              = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.tls_keyfile              = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cache.username                 = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] coordination.backend_url       = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.asyncio_connection    = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.asyncio_slave_connection = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.backend               = sqlalchemy {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.connection            = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.connection_debug      = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.connection_parameters =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.connection_recycle_time = 3600 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.connection_trace      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.db_inc_retry_interval = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.db_max_retries        = 20 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.db_max_retry_interval = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.db_retry_interval     = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.max_overflow          = 50 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.max_pool_size         = 5 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.max_retries           = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.mysql_wsrep_sync_wait = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.pool_timeout          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.retry_interval        = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.slave_connection      = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.sqlite_synchronous    = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.synchronous_reader    = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] database.use_db_reconnect      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.connection_string     = messaging:// {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.enabled               = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.es_doc_type           = notification {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.es_scroll_size        = 10000 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.es_scroll_time        = 2m {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.filter_error_trace    = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.hmac_keys             = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.sentinel_service_name = mymaster {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.socket_timeout        = 0.1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.trace_requests        = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler.trace_sqlalchemy      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler_jaeger.process_tags   = {} {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler_jaeger.service_name_prefix = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] profiler_otlp.service_name_prefix = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.enforce_new_defaults = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: WARNING oslo_config.cfg [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.enforce_scope      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.policy_default_rule = default {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.group          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.helper_command = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] privsep_osbrick.user           = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.group         = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.helper_command = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] cinder_sys_admin.user          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.auth_section      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.auth_type         = password {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.cafile            = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.certfile          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.collect_timing    = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.insecure          = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.keyfile           = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.send_service_user_token = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.split_loggers     = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] service_user.timeout           = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.auth_section            = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.auth_type               = password {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.certfile                = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.collect_timing          = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.insecure                = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.keyfile                 = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.region_name             = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.split_loggers           = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] glance.timeout                 = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.backend_availability_zone = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.chap_password = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.chap_username =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.disk_geometry = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.driver_client_cert = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.driver_client_cert_key = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.driver_data_namespace = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.driver_use_ssl = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.extra_capabilities = {} {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.filter_function = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.goodness_function = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.iscsi_target_flags =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.iscsi_write_cache = on {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.iser_port     = 3260 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.lvm_share_target = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.lvm_type      = auto {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.num_shell_tries = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.replication_device = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.report_discard_supported = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.reserved_percentage = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.target_helper = tgtadm {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.target_port   = 3260 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.target_protocol = iscsi {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.trace_flags   = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.unique_fqdn_network = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.use_chap_auth = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_backend_name = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_clear  = zero {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_clear_ionice = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_clear_size = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_reports.file_event_handler = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_reports.log_dir           = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.backend_host       = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.chap_password      = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.chap_username      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.disk_geometry      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.driver_client_cert = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.extra_capabilities = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.filter_function    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.goodness_function  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.iser_helper        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.iser_port          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.lvm_type           = auto {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.replication_device = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.report_discard_supported = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.reserved_percentage = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.scst_target_driver = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.storage_protocol   = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.target_ip_address  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.target_port        = 3260 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.trace_flags        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_clear       = zero {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] lvmdriver-1.volumes_dir        = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_notifications.driver = [] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_notifications.retry = -1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] key_manager.fixed_key          = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.barbican_api_version  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.barbican_endpoint     = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.barbican_endpoint_type = public {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.barbican_region_name  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.cafile                = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.certfile              = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.collect_timing        = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.insecure              = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.keyfile               = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.number_of_retries     = 60 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.retry_delay           = 1 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.send_service_user_token = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.split_loggers         = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.timeout               = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.verify_ssl            = True {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican.verify_ssl_path       = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.auth_section = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.auth_type = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.cafile   = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.certfile = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.collect_timing = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.insecure = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.keyfile  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.split_loggers = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] barbican_service_user.timeout  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.approle_role_id          = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.approle_secret_id        = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.kv_mountpoint            = secret {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.kv_path                  = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.kv_version               = 2 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.namespace                = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.root_token_id            = **** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.ssl_ca_crt_file          = None {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.timeout                  = 60.0 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.use_ssl                  = False {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:33:17 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] ******************************************************************************** {{(pid=72643) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 18:33:18 devstack sudo[72751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 20 18:33:18 devstack sudo[72751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:18 devstack sudo[72751]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:18 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:18 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:18 devstack sudo[72761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:18 devstack sudo[72761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:19 devstack sudo[72761]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.535s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:33:19 devstack cinder-volume[72747]: INFO cinder.brick.local_dev.lvm [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:19 devstack sudo[73004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:33:19 devstack sudo[73004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:19 devstack sudo[73004]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.525s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG cinder.brick.local_dev.lvm [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72747) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 20 18:33:19 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:19 devstack sudo[73238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:19 devstack sudo[73238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:20 devstack sudo[73238]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:20 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.093s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:20 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:20 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:20 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:20 devstack sudo[73443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:20 devstack sudo[73443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:21 devstack sudo[73443]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:21 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:21 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:21 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:21 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:21 devstack sudo[73447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 20 18:33:21 devstack sudo[73447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:21 devstack sudo[73447]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:21 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.424s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:21 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:21 devstack sudo[73450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:33:21 devstack sudo[73450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:22 devstack sudo[73450]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:22 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:22 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:22 devstack sudo[73455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:33:22 devstack sudo[73455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:22 devstack sudo[73455]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:22 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:22 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:22 devstack sudo[73461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:22 devstack sudo[73461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:22 devstack sudo[73461]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:22 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:22 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:22 devstack sudo[73466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:22 devstack sudo[73466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:23 devstack sudo[73466]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:23 devstack sudo[73470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:23 devstack sudo[73470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:23 devstack sudo[73470]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:23 devstack cinder-volume[72747]: INFO cinder.volume.drivers.lvm [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:23 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:23 devstack sudo[73478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:23 devstack sudo[73478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:24 devstack sudo[73478]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:24 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:24 devstack cinder-volume[72747]: DEBUG cinder.volume.drivers.lvm [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Updating volume stats {{(pid=72747) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 18:33:24 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:24 devstack sudo[73532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:33:24 devstack sudo[73532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:24 devstack sudo[73532]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:24 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:24 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:24 devstack sudo[73601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:24 devstack sudo[73601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:25 devstack sudo[73601]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:25 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:25 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:25 devstack sudo[73640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:25 devstack sudo[73640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:25 devstack sudo[73640]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:25 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:25 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:25 devstack sudo[73743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:25 devstack sudo[73743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:26 devstack sudo[73743]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:26 devstack cinder-volume[72747]: INFO cinder.volume.driver [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG cinder.volume.driver [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72747) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG oslo_db.sqlalchemy.engines [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72747) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG dbcounter [-] [72747] Writer thread running {{(pid=72747) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG cinder.db.sqlalchemy.api [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Building query based on filter {{(pid=72747) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG cinder.image.image_utils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72747) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 18:33:26 devstack cinder-volume[72747]: INFO cinder.keymgr.migration [None req-ae34c96f-58c6-4bce-8e53-63687e24f433 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG cinder.volume.drivers.lvm [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Updating volume stats {{(pid=72747) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:26 devstack sudo[73751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:33:26 devstack sudo[73751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:26 devstack sudo[73751]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:26 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:26 devstack sudo[73754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:26 devstack sudo[73754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:27 devstack sudo[73754]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:27 devstack sudo[73757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:27 devstack sudo[73757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:27 devstack sudo[73757]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.419s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:27 devstack sudo[73760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:27 devstack sudo[73760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:27 devstack cinder-volume[72643]: DEBUG dbcounter [-] [72643] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72643) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:33:27 devstack sudo[73760]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG cinder.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Notifying Schedulers of capabilities ... {{(pid=72747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:33:27 devstack cinder-volume[72747]: INFO cinder.volume.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Driver initialization completed successfully.
Apr 20 18:33:27 devstack cinder-volume[72747]: INFO cinder.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Initiating service 2 cleanup
Apr 20 18:33:27 devstack cinder-volume[72747]: INFO cinder.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Service 2 cleanup completed.
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG cinder.service [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Creating RPC server for service cinder-volume {{(pid=72747) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG cinder.service [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72747) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 18:33:27 devstack cinder-volume[72747]: INFO cinder.volume.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG cinder.volume.drivers.lvm [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Updating volume stats {{(pid=72747) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 18:33:27 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:28 devstack sudo[73766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:33:28 devstack sudo[73766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:28 devstack sudo[73766]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:28 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:28 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:28 devstack sudo[73774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:28 devstack sudo[73774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:28 devstack sudo[73774]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:28 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:28 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:29 devstack sudo[73777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:33:29 devstack sudo[73777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:29 devstack sudo[73777]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:29 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:29 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:33:29 devstack sudo[73834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:33:29 devstack sudo[73834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:33:29 devstack sudo[73834]: pam_unix(sudo:session): session closed for user root
Apr 20 18:33:29 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:33:29 devstack cinder-volume[72747]: INFO cinder.volume.manager [None req-6f2d15fc-f1e2-4a45-a06d-f38468fe04d4 None None] Driver post RPC initialization completed successfully.
Apr 20 18:33:37 devstack cinder-volume[72747]: DEBUG dbcounter [-] [72747] Writing DB stats cinder:SELECT=3 {{(pid=72747) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:33:39 devstack cinder-volume[72747]: DEBUG dbcounter [-] [72747] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72747) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:34:54 devstack cinder-volume[72747]: DEBUG oslo_service.periodic_task [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72747) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:34:54 devstack cinder-volume[72747]: DEBUG cinder.volume.drivers.lvm [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Updating volume stats {{(pid=72747) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 18:34:54 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:34:54 devstack sudo[78767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:34:54 devstack sudo[78767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:34:55 devstack sudo[78767]: pam_unix(sudo:session): session closed for user root
Apr 20 18:34:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:34:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:34:55 devstack sudo[78811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:34:55 devstack sudo[78811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:34:55 devstack sudo[78811]: pam_unix(sudo:session): session closed for user root
Apr 20 18:34:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:34:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:34:55 devstack sudo[78819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:34:55 devstack sudo[78819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:34:56 devstack sudo[78819]: pam_unix(sudo:session): session closed for user root
Apr 20 18:34:56 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.412s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:34:56 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:34:56 devstack sudo[78822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:34:56 devstack sudo[78822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:34:56 devstack sudo[78822]: pam_unix(sudo:session): session closed for user root
Apr 20 18:34:56 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:34:56 devstack cinder-volume[72747]: DEBUG cinder.manager [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Notifying Schedulers of capabilities ... {{(pid=72747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:35:39 devstack cinder-volume[72747]: DEBUG dbcounter [-] [72747] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72747) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:35:54 devstack cinder-volume[72747]: DEBUG oslo_service.periodic_task [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72747) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:35:54 devstack cinder-volume[72747]: DEBUG cinder.volume.drivers.lvm [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Updating volume stats {{(pid=72747) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 18:35:54 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:35:54 devstack sudo[80687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 18:35:54 devstack sudo[80687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:35:55 devstack sudo[80687]: pam_unix(sudo:session): session closed for user root
Apr 20 18:35:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:35:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:35:55 devstack sudo[80694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:35:55 devstack sudo[80694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:35:55 devstack sudo[80694]: pam_unix(sudo:session): session closed for user root
Apr 20 18:35:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:35:55 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:35:55 devstack sudo[80697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 18:35:55 devstack sudo[80697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:35:56 devstack sudo[80697]: pam_unix(sudo:session): session closed for user root
Apr 20 18:35:56 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.419s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:35:56 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:35:56 devstack sudo[80701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 18:35:56 devstack sudo[80701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:35:56 devstack sudo[80701]: pam_unix(sudo:session): session closed for user root
Apr 20 18:35:56 devstack cinder-volume[72747]: DEBUG oslo_concurrency.processutils [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.413s {{(pid=72747) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:35:56 devstack cinder-volume[72747]: DEBUG cinder.manager [None req-156c081b-bcf3-42ee-92b8-b60c0f2d0ec7 None None] Notifying Schedulers of capabilities ... {{(pid=72747) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:36:43 devstack cinder-volume[72643]: INFO oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Caught SIGTERM, stopping children
Apr 20 18:36:43 devstack cinder-volume[72643]: DEBUG oslo_concurrency.lockutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Acquiring lock "singleton_lock" {{(pid=72643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:36:43 devstack cinder-volume[72643]: DEBUG oslo_concurrency.lockutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Acquired lock "singleton_lock" {{(pid=72643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:36:43 devstack cinder-volume[72643]: DEBUG oslo_concurrency.lockutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Releasing lock "singleton_lock" {{(pid=72643) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:36:43 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Stop services. {{(pid=72643) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 20 18:36:43 devstack cinder-volume[72643]: DEBUG oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Killing children. {{(pid=72643) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 20 18:36:43 devstack cinder-volume[72643]: INFO oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Waiting on 1 children to exit
Apr 20 18:36:47 devstack cinder-volume[72747]: DEBUG oslo_concurrency.lockutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Acquiring lock "singleton_lock" {{(pid=72747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:36:47 devstack cinder-volume[72747]: DEBUG oslo_concurrency.lockutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Acquired lock "singleton_lock" {{(pid=72747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:36:47 devstack cinder-volume[72747]: DEBUG oslo_concurrency.lockutils [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Releasing lock "singleton_lock" {{(pid=72747) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:36:47 devstack cinder-volume[72747]: WARNING amqp [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 18:36:47 devstack cinder-volume[72747]: WARNING amqp [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 18:36:48 devstack cinder-volume[72643]: INFO oslo_service.backend._eventlet.service [None req-ca9823aa-31d5-40f4-9ce7-672417ebe4c2 None None] Child 72747 exited with status 0
Apr 20 18:36:48 devstack cinder-volume[81792]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 18:36:48 devstack cinder-volume[81792]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 18:36:48 devstack cinder-volume[81792]: we strongly recommend against using it for new projects.
Apr 20 18:36:48 devstack cinder-volume[81792]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 18:36:48 devstack cinder-volume[81792]: framework.  For more detail see
Apr 20 18:36:48 devstack cinder-volume[81792]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 18:36:48 devstack cinder-volume[81792]:   import eventlet  # noqa
Apr 20 18:36:50 devstack cinder-volume[81792]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:36:50 devstack cinder-volume[81792]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:36:50 devstack cinder-volume[81792]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:36:50 devstack cinder-volume[81792]: INFO dbcounter [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Registered counter for database cinder
Apr 20 18:36:50 devstack cinder-volume[81792]: DEBUG oslo_db.sqlalchemy.engines [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:50 devstack cinder-volume[81792]: DEBUG dbcounter [-] [81792] Writer thread running {{(pid=81792) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 18:36:50 devstack cinder-volume[81792]: INFO cinder.rpc [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 18:36:50 devstack cinder-volume[81792]: INFO cinder.rpc [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 18:36:50 devstack cinder-volume[81792]: DEBUG oslo_db.sqlalchemy.engines [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:51 devstack cinder-volume[81792]: INFO cinder.volume.manager [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Determined volume DB was empty at startup.
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG cinder.volume.manager [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81792) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 18:36:51 devstack cinder-volume[81792]: INFO cinder.volume.manager [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 20 18:36:51 devstack cinder-volume[81792]: WARNING stevedore.named [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 18:36:51 devstack cinder-volume[81792]: WARNING castellan.key_manager [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:36:51 devstack cinder-volume[81792]: WARNING cinder.keymgr.conf_key_mgr [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:36:51 devstack cinder-volume[81792]: INFO cinder.volume.manager [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_db.sqlalchemy.engines [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81792) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:51 devstack cinder-volume[81792]: INFO oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Starting 1 workers
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Started child 81908 {{(pid=81792) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Full set of CONF: {{(pid=81792) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] ******************************************************************************** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Configuration options gathered from: {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] ================================================================================ {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] allow_availability_zone_fallback = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] allow_compression_on_image_upload = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] allowed_direct_url_schemes     = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] api_rate_limit                 = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] auth_strategy                  = keystone {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_availability_zone      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_host                   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_name                   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_stats_polling_interval = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backup_api_class               = cinder.backup.api.API {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backup_name_template           = backup-%s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backup_use_same_host           = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backup_use_temp_snapshot       = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] chap_password                  = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] chap_username                  =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_internal_tenant_project_id = caf93a4772f44d23875acefdc303a2bd {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_internal_tenant_user_id = 5ddb9509229341f9801238d5b64eb88d {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cluster                        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] compression_format             = gzip {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] compute_api_class              = cinder.compute.nova.API {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] config_dir                     = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] config_source                  = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] control_exchange               = openstack {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] debug                          = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] default_availability_zone      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] default_group_type             = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] default_volume_type            = QuobyteHD {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] disk_geometry                  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] driver_client_cert             = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] driver_client_cert_key         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] driver_data_namespace          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] driver_ssl_cert_path           = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81908]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] driver_ssl_cert_verify         = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] driver_use_ssl                 = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] enable_new_services            = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] enable_unsupported_driver      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] enabled_backends               = ['QuobyteHD'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] enforce_multipath_for_image_xfer = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] filter_function                = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_api_insecure            = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_api_servers             = ['http://192.168.122.254/image'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_api_ssl_compression     = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_ca_certificates_file    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_catalog_info            = image:glance:publicURL {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_certfile                = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_keyfile                 = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_num_retries             = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance_request_timeout         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] goodness_function              = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] graceful_shutdown_timeout      = 5 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] group_api_class                = cinder.group.api.API {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] host                           = devstack {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_compress_on_upload       = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_conversion_address_space_limit = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_conversion_cpu_limit     = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_conversion_disable       = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_upload_use_cinder_backend = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_upload_use_internal_tenant = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_volume_cache_enabled     = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_volume_cache_max_count   = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] image_volume_cache_max_size_gb = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] init_host_max_objects_retrieval = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] instance_format                = [instance: %(uuid)s]  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] iscsi_target_flags             =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] iscsi_write_cache              = on {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] iser_helper                    = tgtadm {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] iser_ip_address                = 192.168.122.254 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] iser_port                      = 3260 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_color                      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_config_append              = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_dir                        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_file                       = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_options                    = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_rotate_interval            = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_rotate_interval_type       = days {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] log_rotation_type              = none {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] max_age                        = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] max_logfile_count              = 30 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] max_logfile_size_mb            = 200 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] max_over_subscription_ratio    = 20.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] message_reap_interval          = 86400 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] message_ttl                    = 2592000 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] migration_create_volume_timeout_secs = 300 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] monkey_patch                   = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] monkey_patch_modules           = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] my_ip                          = 192.168.122.254 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] no_snapshot_gb_quota           = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] num_iser_scan_tries            = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] num_shell_tries                = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] num_volume_device_scan_tries   = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] nvmeof_conn_info_version       = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] nvmet_ns_id                    = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] nvmet_port_id                  = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_max_limit                = 1000 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_volume_ext_list          = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_volume_listen_port       = 8776 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_volume_use_ssl           = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] osapi_volume_workers           = 2 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] per_volume_size_limit          = -1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] periodic_fuzzy_delay           = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] periodic_interval              = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] public_endpoint                = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] publish_errors                 = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_backup_gigabytes         = 1000 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_backups                  = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_gigabytes                = 1000 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_groups                   = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81908]: INFO cinder.volume.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_snapshots                = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] quota_volumes                  = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] rate_limit_burst               = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] rate_limit_except_level        = CRITICAL {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.remotefs [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81908) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] rate_limit_interval            = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] reinit_driver_count            = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] replication_device             = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] report_discard_supported       = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] report_interval                = 120 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] reservation_clean_interval     = 86400 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] reservation_expire             = 86400 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] reserved_image_namespaces      = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] reserved_percentage            = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] rpc_response_timeout           = 120 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] run_external_periodic_tasks    = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] scst_target_driver             = iscsi {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] scst_target_iqn_name           = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_down_time              = 720 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] shell_completion               = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] snapshot_name_template         = snapshot-%s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] split_loggers                  = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] state_path                     = /opt/stack/data/cinder {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] storage_availability_zone      = nova {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] storage_protocol               = iSCSI {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] syslog_log_facility            = LOG_USER {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] target_helper                  = lioadm {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] target_ip_address              = 192.168.122.254 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] target_port                    = 3260 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] target_protocol                = iscsi {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] target_secondary_ip_addresses  = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] trace_flags                    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] transport_url                  = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] until_refresh                  = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_chap_auth                  = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_default_quota_class        = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_journal                    = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_json                       = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_multipath_for_image_xfer   = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_stderr                     = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] use_syslog                     = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] verify_glance_signatures       = enabled {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_api_class               = cinder.volume.api.API {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_backend_name            = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_clear                   = zero {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_clear_ionice            = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_clear_size              = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_copy_bps_limit          = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_dd_blocksize            = 1M {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_name_template           = volume-%s {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_service_inithost_offload = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volume_usage_audit_period      = month {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] zoning_mode                    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_concurrency.disable_process_locking = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.admin_password = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.admin_token = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.admin_user  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_port   = 35357 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_protocol = https {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_section = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_type   = password {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_uri    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.auth_version = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.cache       = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.certfile    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.delay_auth_decision = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.http_connect_timeout = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.identity_uri = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.include_service_catalog = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.insecure    = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.interface   = public {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.keyfile     = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_password =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcache_username =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.region_name = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.service_token_roles_required = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.service_type = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.token_cache_time = 300 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.backend                  = dogpile.cache.null {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.backend_argument         = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.backend_expiration_time  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.config_prefix            = cache.oslo {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.debug_cache_backend      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.enable_retry_client      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.enable_socket_keepalive  = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.enabled                  = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.enforce_fips_mode        = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.expiration_time          = 600 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.hashclient_retry_attempts = 2 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_dead_retry      = 300 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_pool_maxsize    = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_sasl_enabled    = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.password                 = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.proxies                  = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.redis_db                 = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.redis_sentinel_service_name = mymaster {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.redis_server             = localhost:6379 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.retry_attempts           = 2 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.retry_delay              = 0.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.socket_keepalive_count   = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.socket_keepalive_idle    = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.socket_keepalive_interval = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.socket_timeout           = 1.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.tls_allowed_ciphers      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.tls_cafile               = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.tls_certfile             = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.tls_enabled              = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.tls_keyfile              = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cache.username                 = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] coordination.backend_url       = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.asyncio_connection    = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.asyncio_slave_connection = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.backend               = sqlalchemy {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.connection            = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.connection_debug      = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.connection_parameters =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.connection_recycle_time = 3600 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.connection_trace      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.db_inc_retry_interval = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.db_max_retries        = 20 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.db_max_retry_interval = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.db_retry_interval     = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.max_overflow          = 50 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.max_pool_size         = 5 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.max_retries           = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.mysql_wsrep_sync_wait = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.pool_timeout          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.retry_interval        = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.slave_connection      = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.sqlite_synchronous    = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.synchronous_reader    = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] database.use_db_reconnect      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.connection_string     = messaging:// {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.enabled               = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.es_doc_type           = notification {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.es_scroll_size        = 10000 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.es_scroll_time        = 2m {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.filter_error_trace    = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.hmac_keys             = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.sentinel_service_name = mymaster {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.socket_timeout        = 0.1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.trace_requests        = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler.trace_sqlalchemy      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler_jaeger.process_tags   = {} {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler_jaeger.service_name_prefix = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] profiler_otlp.service_name_prefix = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.enforce_new_defaults = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81908) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 20 18:36:51 devstack cinder-volume[81908]: WARNING cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 20 18:36:51 devstack cinder-volume[81792]: WARNING oslo_config.cfg [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 18:36:51 devstack cinder-volume[81908]: WARNING cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.enforce_scope      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.policy_default_rule = default {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.policy_file        = policy.yaml {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Running cmd (subprocess): mount.quobyte {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.group          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.helper_command = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] privsep_osbrick.user           = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.group         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.helper_command = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] cinder_sys_admin.user          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.auth_section      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.auth_type         = password {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.cafile            = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.certfile          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.collect_timing    = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.insecure          = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.keyfile           = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.send_service_user_token = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.split_loggers     = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] service_user.timeout           = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.auth_section            = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.auth_type               = password {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.certfile                = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.collect_timing          = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.insecure                = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.keyfile                 = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.region_name             = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.split_loggers           = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] glance.timeout                 = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.backend_availability_zone = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.chap_password = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.chap_username =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.disk_geometry = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.driver_client_cert = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.driver_client_cert_key = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.driver_data_namespace = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.driver_use_ssl = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.enable_unsupported_driver = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.extra_capabilities = {} {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.filter_function = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.goodness_function = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.iscsi_target_flags =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.iscsi_write_cache = on {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.iser_helper   = tgtadm {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.iser_port     = 3260 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_host      =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_login     = admin {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_mount_options = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_password  = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_private_key =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_share_path =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.num_shell_tries = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.nvmet_port_id = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_client_cfg = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.quobyte_volume_url = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.replication_device = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.report_discard_supported = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.reserved_percentage = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.scst_target_driver = iscsi {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.scst_target_iqn_name = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.storage_protocol = iSCSI {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.target_helper = tgtadm {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.target_port   = 3260 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.target_protocol = iscsi {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.trace_flags   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.unique_fqdn_network = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.use_chap_auth = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_backend_name = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_clear  = zero {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_clear_ionice = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_clear_size = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_reports.file_event_handler = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_reports.log_dir           = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.backend_availability_zone = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.backend_host         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.chap_password        = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.chap_username        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.chiscsi_conf         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.disk_geometry        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.driver_client_cert   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.driver_client_cert_key = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.driver_data_namespace = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.driver_use_ssl       = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.extra_capabilities   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.filter_function      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.goodness_function    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.iser_helper          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.iser_ip_address      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.iser_port            = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.iser_target_prefix   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_host             = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_login            = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_mount_options    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_password         = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_private_key      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_share_path       = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_ssh_port         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.num_shell_tries      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.nvmet_port_id        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.replication_device   = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.report_discard_supported = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.reserved_percentage  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.scst_target_driver   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.storage_protocol     = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.target_helper        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.target_ip_address    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.target_port          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.target_prefix        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.target_protocol      = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.trace_flags          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.use_chap_auth        = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_clear         = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_clear_size    = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] QuobyteHD.volumes_dir          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.ssl      = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_notifications.driver = [] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_notifications.retry = -1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] oslo_messaging_notifications.transport_url = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack quobyte-client[81912]: Reading configuration file: /etc/quobyte/client.cfg
Apr 20 18:36:51 devstack quobyte-client[81912]: Invalid parameters found, error: missing mount point.
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] key_manager.fixed_key          = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack quobyte-client[81912]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 20 18:36:51 devstack quobyte-client[81912]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.barbican_api_version  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.barbican_endpoint     = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.barbican_endpoint_type = public {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.barbican_region_name  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.cafile                = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.certfile              = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.collect_timing        = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.insecure              = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.keyfile               = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.number_of_retries     = 60 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.retry_delay           = 1 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.send_service_user_token = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.split_loggers         = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.timeout               = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.verify_ssl            = True {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican.verify_ssl_path       = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.auth_section = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.auth_type = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.cafile   = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.certfile = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.collect_timing = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.insecure = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.keyfile  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.split_loggers = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] barbican_service_user.timeout  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.approle_role_id          = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.approle_secret_id        = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.kv_mountpoint            = secret {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.kv_path                  = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.kv_version               = 2 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.namespace                = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.root_token_id            = **** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.ssl_ca_crt_file          = None {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.timeout                  = 60.0 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.use_ssl                  = False {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:51 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] ******************************************************************************** {{(pid=81792) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=81908) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:36:51 devstack cinder-volume[81908]: INFO cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba ...
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad -c /etc/quobyte/client-cinder.cfg {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:51 devstack sudo[81913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad -c /etc/quobyte/client-cinder.cfg
Apr 20 18:36:51 devstack sudo[81913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:36:51 devstack sudo[81913]: pam_unix(sudo:session): session closed for user root
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.496s {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:36:51 devstack cinder-volume[81908]: INFO cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba succeeded
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=81908) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.502s {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:36:51 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:51 devstack sudo[81982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:36:51 devstack sudo[81982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:36:52 devstack sudo[81982]: pam_unix(sudo:session): session closed for user root
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.399s {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:36:52 devstack cinder-volume[81908]: INFO cinder.volume.driver [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.volume.driver [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81908) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_db.sqlalchemy.engines [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81908) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG dbcounter [-] [81908] Writer thread running {{(pid=81908) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.db.sqlalchemy.api [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Building query based on filter {{(pid=81908) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.image.image_utils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81908) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 18:36:52 devstack cinder-volume[81908]: INFO cinder.keymgr.migration [None req-ac5514b8-3d51-4585-9702-5a01e9a93b77 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=81908) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=81908) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:52 devstack sudo[81985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:36:52 devstack sudo[81985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:36:52 devstack sudo[81985]: pam_unix(sudo:session): session closed for user root
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.391s {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Notifying Schedulers of capabilities ... {{(pid=81908) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:36:52 devstack cinder-volume[81908]: INFO cinder.volume.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Driver initialization completed successfully.
Apr 20 18:36:52 devstack cinder-volume[81908]: INFO cinder.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Initiating service 3 cleanup
Apr 20 18:36:52 devstack cinder-volume[81908]: INFO cinder.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Service 3 cleanup completed.
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.service [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Creating RPC server for service cinder-volume {{(pid=81908) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.service [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81908) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 18:36:52 devstack cinder-volume[81908]: INFO cinder.volume.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=81908) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG cinder.volume.drivers.quobyte [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=81908) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81908) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:36:52 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:52 devstack sudo[81990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:36:52 devstack sudo[81990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:36:53 devstack sudo[81990]: pam_unix(sudo:session): session closed for user root
Apr 20 18:36:53 devstack cinder-volume[81908]: DEBUG oslo_concurrency.processutils [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.417s {{(pid=81908) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:36:53 devstack cinder-volume[81908]: INFO cinder.volume.manager [None req-ce820410-fd84-4ae2-837e-3701a80c177b None None] Driver post RPC initialization completed successfully.
Apr 20 18:36:55 devstack cinder-volume[81792]: INFO oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Caught SIGTERM, stopping children
Apr 20 18:36:55 devstack cinder-volume[81792]: DEBUG oslo_concurrency.lockutils [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Acquiring lock "singleton_lock" {{(pid=81792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:36:55 devstack cinder-volume[81792]: DEBUG oslo_concurrency.lockutils [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Acquired lock "singleton_lock" {{(pid=81792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:36:55 devstack cinder-volume[81792]: DEBUG oslo_concurrency.lockutils [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Releasing lock "singleton_lock" {{(pid=81792) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:36:55 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Stop services. {{(pid=81792) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 20 18:36:55 devstack cinder-volume[81792]: DEBUG oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Killing children. {{(pid=81792) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 20 18:36:55 devstack cinder-volume[81792]: INFO oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Waiting on 1 children to exit
Apr 20 18:36:56 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Acquiring lock "singleton_lock" {{(pid=81908) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:36:56 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Acquired lock "singleton_lock" {{(pid=81908) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:36:56 devstack cinder-volume[81908]: DEBUG oslo_concurrency.lockutils [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Releasing lock "singleton_lock" {{(pid=81908) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:36:56 devstack cinder-volume[81908]: WARNING amqp [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 18:36:56 devstack cinder-volume[81908]: WARNING amqp [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 18:36:56 devstack cinder-volume[81792]: INFO oslo_service.backend._eventlet.service [None req-2f3b7d18-76ae-44e2-9c09-894a8f29baed None None] Child 81908 exited with status 0
Apr 20 18:36:57 devstack cinder-volume[82129]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 18:36:57 devstack cinder-volume[82129]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 18:36:57 devstack cinder-volume[82129]: we strongly recommend against using it for new projects.
Apr 20 18:36:57 devstack cinder-volume[82129]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 18:36:57 devstack cinder-volume[82129]: framework.  For more detail see
Apr 20 18:36:57 devstack cinder-volume[82129]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 18:36:57 devstack cinder-volume[82129]:   import eventlet  # noqa
Apr 20 18:36:58 devstack cinder-volume[82129]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 18:36:58 devstack cinder-volume[82129]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 18:36:58 devstack cinder-volume[82129]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82129) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 18:36:59 devstack cinder-volume[82129]: INFO dbcounter [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Registered counter for database cinder
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_db.sqlalchemy.engines [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG dbcounter [-] [82129] Writer thread running {{(pid=82129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 18:36:59 devstack cinder-volume[82129]: INFO cinder.rpc [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 18:36:59 devstack cinder-volume[82129]: INFO cinder.rpc [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_db.sqlalchemy.engines [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:59 devstack cinder-volume[82129]: INFO cinder.volume.manager [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Determined volume DB was empty at startup.
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG cinder.volume.manager [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82129) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 18:36:59 devstack cinder-volume[82129]: WARNING stevedore.named [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 18:36:59 devstack cinder-volume[82129]: WARNING castellan.key_manager [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:36:59 devstack cinder-volume[82129]: WARNING cinder.keymgr.conf_key_mgr [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 18:36:59 devstack cinder-volume[82129]: INFO cinder.volume.manager [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_db.sqlalchemy.engines [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82129) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:36:59 devstack cinder-volume[82129]: INFO oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Starting 1 workers
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Started child 82268 {{(pid=82129) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Full set of CONF: {{(pid=82129) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] ******************************************************************************** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Configuration options gathered from: {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] ================================================================================ {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] allow_availability_zone_fallback = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] allow_compression_on_image_upload = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] allowed_direct_url_schemes     = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] api_rate_limit                 = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] auth_strategy                  = keystone {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_availability_zone      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_host                   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_name                   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_stats_polling_interval = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backup_api_class               = cinder.backup.api.API {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backup_name_template           = backup-%s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backup_use_same_host           = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backup_use_temp_snapshot       = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] chap_password                  = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] chap_username                  =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_internal_tenant_project_id = caf93a4772f44d23875acefdc303a2bd {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_internal_tenant_user_id = 5ddb9509229341f9801238d5b64eb88d {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cluster                        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] compression_format             = gzip {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] compute_api_class              = cinder.compute.nova.API {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] config_dir                     = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] config_source                  = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] control_exchange               = openstack {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] debug                          = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] default_availability_zone      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] default_group_type             = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] default_volume_type            = QuobyteHD {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] disk_geometry                  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] driver_client_cert             = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] driver_client_cert_key         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] driver_data_namespace          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] driver_ssl_cert_path           = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] driver_ssl_cert_verify         = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] driver_use_ssl                 = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] enable_new_services            = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] enable_unsupported_driver      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] enabled_backends               = ['QuobyteHD'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] enforce_multipath_for_image_xfer = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] filter_function                = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_api_insecure            = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_api_servers             = ['http://192.168.122.254/image'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_api_ssl_compression     = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_ca_certificates_file    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_catalog_info            = image:glance:publicURL {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_certfile                = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_keyfile                 = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_num_retries             = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance_request_timeout         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] goodness_function              = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] graceful_shutdown_timeout      = 5 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] group_api_class                = cinder.group.api.API {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] host                           = devstack {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_compress_on_upload       = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_conversion_address_space_limit = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_conversion_cpu_limit     = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_conversion_disable       = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_upload_use_cinder_backend = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_upload_use_internal_tenant = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_volume_cache_enabled     = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_volume_cache_max_count   = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] image_volume_cache_max_size_gb = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] init_host_max_objects_retrieval = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] instance_format                = [instance: %(uuid)s]  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] iscsi_target_flags             =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] iscsi_write_cache              = on {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] iser_helper                    = tgtadm {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] iser_ip_address                = 192.168.122.254 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82268]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] iser_port                      = 3260 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_color                      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_config_append              = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_dir                        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_file                       = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_options                    = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_rotate_interval            = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_rotate_interval_type       = days {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] log_rotation_type              = none {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] max_age                        = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] max_logfile_count              = 30 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] max_logfile_size_mb            = 200 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] max_over_subscription_ratio    = 20.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] message_reap_interval          = 86400 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] message_ttl                    = 2592000 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] migration_create_volume_timeout_secs = 300 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] monkey_patch                   = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] monkey_patch_modules           = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] my_ip                          = 192.168.122.254 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] no_snapshot_gb_quota           = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] num_iser_scan_tries            = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] num_shell_tries                = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] num_volume_device_scan_tries   = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] nvmeof_conn_info_version       = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] nvmet_ns_id                    = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] nvmet_port_id                  = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_max_limit                = 1000 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_volume_ext_list          = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_volume_listen_port       = 8776 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_volume_use_ssl           = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] osapi_volume_workers           = 2 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] per_volume_size_limit          = -1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] periodic_fuzzy_delay           = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] periodic_interval              = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] public_endpoint                = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] publish_errors                 = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_backup_gigabytes         = 1000 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_backups                  = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_gigabytes                = 1000 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_groups                   = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_snapshots                = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] quota_volumes                  = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] rate_limit_burst               = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] rate_limit_except_level        = CRITICAL {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] rate_limit_interval            = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] reinit_driver_count            = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] replication_device             = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] report_discard_supported       = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] report_interval                = 120 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] reservation_clean_interval     = 86400 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] reservation_expire             = 86400 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] reserved_image_namespaces      = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] reserved_percentage            = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] rpc_response_timeout           = 120 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] run_external_periodic_tasks    = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] scst_target_driver             = iscsi {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] scst_target_iqn_name           = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_down_time              = 720 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] shell_completion               = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] snapshot_name_template         = snapshot-%s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] split_loggers                  = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] state_path                     = /opt/stack/data/cinder {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] storage_availability_zone      = nova {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] storage_protocol               = iSCSI {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] syslog_log_facility            = LOG_USER {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] target_helper                  = lioadm {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] target_ip_address              = 192.168.122.254 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] target_port                    = 3260 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] target_protocol                = iscsi {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] target_secondary_ip_addresses  = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] trace_flags                    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] transport_url                  = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] until_refresh                  = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_chap_auth                  = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_default_quota_class        = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_journal                    = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_json                       = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_multipath_for_image_xfer   = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_stderr                     = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] use_syslog                     = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] verify_glance_signatures       = enabled {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_api_class               = cinder.volume.api.API {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_backend_name            = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_clear                   = zero {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_clear_ionice            = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_clear_size              = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_copy_bps_limit          = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_dd_blocksize            = 1M {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_name_template           = volume-%s {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_service_inithost_offload = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volume_usage_audit_period      = month {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] zoning_mode                    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_concurrency.disable_process_locking = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.admin_password = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.admin_token = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.admin_user  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_port   = 35357 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_protocol = https {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_section = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_type   = password {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_uri    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.auth_version = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.cache       = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.certfile    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.delay_auth_decision = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.http_connect_timeout = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.identity_uri = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.include_service_catalog = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.insecure    = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.interface   = public {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.keyfile     = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_password =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcache_username =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.region_name = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.service_token_roles_required = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.service_type = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.token_cache_time = 300 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.backend                  = dogpile.cache.null {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.backend_argument         = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.backend_expiration_time  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.config_prefix            = cache.oslo {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.debug_cache_backend      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.enable_retry_client      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.enable_socket_keepalive  = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.enabled                  = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.enforce_fips_mode        = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.expiration_time          = 600 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.hashclient_retry_attempts = 2 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_dead_retry      = 300 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82268) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_pool_maxsize    = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_sasl_enabled    = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.password                 = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.proxies                  = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.redis_db                 = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.redis_sentinel_service_name = mymaster {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.redis_server             = localhost:6379 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.retry_attempts           = 2 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.retry_delay              = 0.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.socket_keepalive_count   = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.socket_keepalive_idle    = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.socket_keepalive_interval = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.socket_timeout           = 1.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.tls_allowed_ciphers      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.tls_cafile               = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.tls_certfile             = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.tls_enabled              = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.tls_keyfile              = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cache.username                 = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] coordination.backend_url       = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.asyncio_connection    = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.asyncio_slave_connection = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.backend               = sqlalchemy {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.connection            = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.connection_debug      = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.connection_parameters =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.connection_recycle_time = 3600 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.connection_trace      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.db_inc_retry_interval = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.db_max_retries        = 20 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.db_max_retry_interval = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.db_retry_interval     = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.max_overflow          = 50 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.max_pool_size         = 5 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.max_retries           = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.mysql_wsrep_sync_wait = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.pool_timeout          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.retry_interval        = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.slave_connection      = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.sqlite_synchronous    = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.synchronous_reader    = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] database.use_db_reconnect      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.connection_string     = messaging:// {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.enabled               = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.es_doc_type           = notification {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.es_scroll_size        = 10000 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.es_scroll_time        = 2m {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.filter_error_trace    = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.hmac_keys             = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.sentinel_service_name = mymaster {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.socket_timeout        = 0.1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.trace_requests        = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler.trace_sqlalchemy      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler_jaeger.process_tags   = {} {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler_jaeger.service_name_prefix = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] profiler_otlp.service_name_prefix = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.enforce_new_defaults = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: WARNING oslo_config.cfg [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.enforce_scope      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.policy_default_rule = default {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.policy_file        = policy.yaml {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.group          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.helper_command = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] privsep_osbrick.user           = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.group         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.helper_command = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] cinder_sys_admin.user          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.auth_section      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.auth_type         = password {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.cafile            = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.certfile          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.collect_timing    = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.insecure          = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.keyfile           = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.send_service_user_token = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.split_loggers     = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] service_user.timeout           = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.auth_section            = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.auth_type               = password {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.certfile                = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.collect_timing          = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.insecure                = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.keyfile                 = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.region_name             = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.split_loggers           = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] glance.timeout                 = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.backend_availability_zone = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.chap_password = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.chap_username =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.disk_geometry = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.driver_client_cert = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.driver_client_cert_key = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.driver_data_namespace = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.driver_use_ssl = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.enable_unsupported_driver = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.extra_capabilities = {} {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.filter_function = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.goodness_function = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.iscsi_target_flags =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.iscsi_write_cache = on {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.iser_helper   = tgtadm {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.iser_port     = 3260 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_host      =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_login     = admin {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_mount_options = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_password  = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_private_key =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_share_path =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.num_shell_tries = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.nvmet_port_id = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_client_cfg = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.quobyte_volume_url = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.replication_device = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.report_discard_supported = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.reserved_percentage = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.scst_target_driver = iscsi {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.scst_target_iqn_name = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.storage_protocol = iSCSI {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.target_helper = tgtadm {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.target_port   = 3260 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.target_protocol = iscsi {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.trace_flags   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.unique_fqdn_network = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.use_chap_auth = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_backend_name = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_clear  = zero {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_clear_ionice = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_clear_size = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_reports.file_event_handler = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_reports.log_dir           = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.backend_availability_zone = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.backend_host         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.chap_password        = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.chap_username        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.chiscsi_conf         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.disk_geometry        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.driver_client_cert   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.driver_client_cert_key = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.driver_data_namespace = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.driver_use_ssl       = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.extra_capabilities   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.filter_function      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.goodness_function    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.iser_helper          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.iser_ip_address      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.iser_port            = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.iser_target_prefix   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_host             = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_login            = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_mount_options    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_password         = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_private_key      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_share_path       = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_ssh_port         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.num_shell_tries      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.nvmet_port_id        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.replication_device   = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.report_discard_supported = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.reserved_percentage  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.scst_target_driver   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.storage_protocol     = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.target_helper        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.target_ip_address    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.target_port          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.target_prefix        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.target_protocol      = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.trace_flags          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.use_chap_auth        = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_clear         = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_clear_size    = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] QuobyteHD.volumes_dir          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.ssl      = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_notifications.driver = [] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_notifications.retry = -1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82268) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] oslo_messaging_notifications.transport_url = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] key_manager.fixed_key          = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.barbican_api_version  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.barbican_endpoint     = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.barbican_endpoint_type = public {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.barbican_region_name  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.cafile                = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.certfile              = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.collect_timing        = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.insecure              = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.keyfile               = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.number_of_retries     = 60 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.retry_delay           = 1 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.send_service_user_token = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.split_loggers         = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.timeout               = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.verify_ssl            = True {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican.verify_ssl_path       = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.auth_section = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.auth_type = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.cafile   = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.certfile = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.collect_timing = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.insecure = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.keyfile  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.split_loggers = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] barbican_service_user.timeout  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.approle_role_id          = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.approle_secret_id        = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Running cmd (subprocess): mount.quobyte {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.kv_mountpoint            = secret {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.kv_path                  = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.kv_version               = 2 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.namespace                = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.root_token_id            = **** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.ssl_ca_crt_file          = None {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.timeout                  = 60.0 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.use_ssl                  = False {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 18:36:59 devstack cinder-volume[82129]: DEBUG oslo_service.backend._eventlet.service [None req-7374b2e5-ef3f-4bc2-9a41-67c14334eeec None None] ******************************************************************************** {{(pid=82129) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 18:36:59 devstack quobyte-client[82273]: Reading configuration file: /etc/quobyte/client.cfg
Apr 20 18:36:59 devstack quobyte-client[82273]: Invalid parameters found, error: missing mount point.
Apr 20 18:36:59 devstack quobyte-client[82273]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 20 18:36:59 devstack quobyte-client[82273]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:36:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:36:59 devstack sudo[82280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:36:59 devstack sudo[82280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:37:00 devstack sudo[82280]: pam_unix(sudo:session): session closed for user root
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.681s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:37:00 devstack cinder-volume[82268]: INFO cinder.volume.driver [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.volume.driver [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82268) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_db.sqlalchemy.engines [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writer thread running {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.db.sqlalchemy.api [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Building query based on filter {{(pid=82268) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82268) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:37:00 devstack cinder-volume[82268]: INFO cinder.keymgr.migration [None req-15ec330d-bfd4-4bd2-8656-75e42484a3e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 18:37:00 devstack sudo[82355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:37:00 devstack sudo[82355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:37:00 devstack sudo[82355]: pam_unix(sudo:session): session closed for user root
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.414s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:37:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Driver initialization completed successfully.
Apr 20 18:37:00 devstack cinder-volume[82268]: INFO cinder.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Initiating service 3 cleanup
Apr 20 18:37:00 devstack cinder-volume[82268]: INFO cinder.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Service 3 cleanup completed.
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.service [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Creating RPC server for service cinder-volume {{(pid=82268) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.service [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82268) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 18:37:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:37:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:37:00 devstack sudo[82374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:37:00 devstack sudo[82374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:37:01 devstack sudo[82374]: pam_unix(sudo:session): session closed for user root
Apr 20 18:37:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:37:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f505a6b7-7e10-4574-a85b-be32c7daa1b0 None None] Driver post RPC initialization completed successfully.
Apr 20 18:37:09 devstack cinder-volume[82129]: DEBUG dbcounter [-] [82129] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82129) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:37:10 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=2 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:37:11 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Flow 'volume_create_manager' (974bce84-88a0-4465-b310-f9189c3775a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2443c8-643b-4cf3-8b09-77b022c05626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Flow 'volume_create_manager' (00f4a5c7-7d46-420d-b4ab-245207bc1e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5105ca11-02bd-4bf0-9fd6-47f1bb479206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2443c8-643b-4cf3-8b09-77b022c05626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1465527968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb17eac-e429-4cbc-877b-926f2941339d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4965da9fc414b41bd071f6b161b65f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:00Z,use_quota=True,user_id='f4bf755542d84043b120da1726fb2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6759fc-8ad6-4bc7-b6bb-f0bcebcad279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6759fc-8ad6-4bc7-b6bb-f0bcebcad279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c328475-36be-4d97-b4c3-8636f1e30f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c328475-36be-4d97-b4c3-8636f1e30f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb17eac-e429-4cbc-877b-926f2941339d', 'volume_name': 'volume-8fb17eac-e429-4cbc-877b-926f2941339d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5f398d-413d-4214-9821-abee9d0966a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5f398d-413d-4214-9821-abee9d0966a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74151930-2cfa-49dc-80ad-a8a3da500d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:37:59 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Volume 8fb17eac-e429-4cbc-877b-926f2941339d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb17eac-e429-4cbc-877b-926f2941339d', 'volume_size': 1}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1465527968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb17eac-e429-4cbc-877b-926f2941339d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4965da9fc414b41bd071f6b161b65f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:00Z,use_quota=True,user_id='f4bf755542d84043b120da1726fb2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Creating volume 8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:37:59 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:37:59 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:37:59 devstack sudo[82692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d 1073741824
Apr 20 18:37:59 devstack sudo[82692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Flow 'volume_create_manager' (7f945e71-4ea4-45f9-88f0-c51daf443030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29a8b5d-0dec-450b-94f9-36254178557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29a8b5d-0dec-450b-94f9-36254178557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1716109864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e96810-3d83-4577-852b-fc5ec00fa840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd42d1484ae94d0f98e559149d672a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:00Z,use_quota=True,user_id='64259cd369884fb78419dfdddc223059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9c4cab-2312-4c53-98e9-1812fb73c985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9c4cab-2312-4c53-98e9-1812fb73c985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc9e47a-8afe-4117-a725-e27940e4c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc9e47a-8afe-4117-a725-e27940e4c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e96810-3d83-4577-852b-fc5ec00fa840', 'volume_name': 'volume-54e96810-3d83-4577-852b-fc5ec00fa840', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a48f8ae-5985-40b7-b200-bee16289f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a48f8ae-5985-40b7-b200-bee16289f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267c9ecb-daa2-4ef7-9fec-acb7d67ebff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Volume 54e96810-3d83-4577-852b-fc5ec00fa840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e96810-3d83-4577-852b-fc5ec00fa840', 'volume_size': 1}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5105ca11-02bd-4bf0-9fd6-47f1bb479206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1262044692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcebd9b-173b-470b-ace8-85d8ea340ced,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4894742ac3f243c685873ee0c7f05010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:00Z,use_quota=True,user_id='c4e0278da415491a9fb552c4928d8e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1284c43-9d30-4146-8910-8768987e7c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1284c43-9d30-4146-8910-8768987e7c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661a7d30-0f2c-4846-a4bb-51e3300abc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (661a7d30-0f2c-4846-a4bb-51e3300abc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcebd9b-173b-470b-ace8-85d8ea340ced', 'volume_name': 'volume-5dcebd9b-173b-470b-ace8-85d8ea340ced', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f858145-d92f-4007-8056-d74eea8d1359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f858145-d92f-4007-8056-d74eea8d1359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6596c3dd-8fc1-4220-9270-ce844a23ee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:00 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Volume 5dcebd9b-173b-470b-ace8-85d8ea340ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcebd9b-173b-470b-ace8-85d8ea340ced', 'volume_size': 1}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:00 devstack sudo[82692]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d 1073741824" returned: 0 in 0.615s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:00 devstack sudo[83017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d
Apr 20 18:38:00 devstack sudo[83017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:01 devstack sudo[83017]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d" returned: 0 in 0.520s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1716109864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e96810-3d83-4577-852b-fc5ec00fa840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd42d1484ae94d0f98e559149d672a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:00Z,use_quota=True,user_id='64259cd369884fb78419dfdddc223059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Creating volume 54e96810-3d83-4577-852b-fc5ec00fa840 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:01 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:01 devstack sudo[83036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840 1073741824
Apr 20 18:38:01 devstack sudo[83036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74151930-2cfa-49dc-80ad-a8a3da500d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb17eac-e429-4cbc-877b-926f2941339d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae05c9c-9e1b-4754-87c7-ad86cb09b571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:01 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Volume volume-8fb17eac-e429-4cbc-877b-926f2941339d (8fb17eac-e429-4cbc-877b-926f2941339d): created successfully
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae05c9c-9e1b-4754-87c7-ad86cb09b571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Flow 'volume_create_manager' (974bce84-88a0-4465-b310-f9189c3775a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-ee66cbb1-b534-4765-afea-f51eea072e13 req-90827ec7-c88d-469e-8dea-3fa6b71377fd tempest-VolumesSnapshotsTestJSON-708154095 None] Created volume successfully.
Apr 20 18:38:01 devstack sudo[83036]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840 1073741824" returned: 0 in 0.493s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:01 devstack sudo[83045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840
Apr 20 18:38:01 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:02 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840" returned: 0 in 0.417s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1262044692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcebd9b-173b-470b-ace8-85d8ea340ced,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4894742ac3f243c685873ee0c7f05010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:00Z,use_quota=True,user_id='c4e0278da415491a9fb552c4928d8e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Creating volume 5dcebd9b-173b-470b-ace8-85d8ea340ced {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:02 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267c9ecb-daa2-4ef7-9fec-acb7d67ebff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e96810-3d83-4577-852b-fc5ec00fa840', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5b8014-8134-4f81-b5f8-86b058358993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:02 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Volume volume-54e96810-3d83-4577-852b-fc5ec00fa840 (54e96810-3d83-4577-852b-fc5ec00fa840): created successfully
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5b8014-8134-4f81-b5f8-86b058358993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:02 devstack sudo[83049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced 1073741824
Apr 20 18:38:02 devstack sudo[83049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Flow 'volume_create_manager' (7f945e71-4ea4-45f9-88f0-c51daf443030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ad00f0ed-68a5-4de8-b393-2708a40dfbe3 tempest-VolumesAdminNegativeTest-1150271080 None] Created volume successfully.
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:02 devstack sudo[83051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:02 devstack sudo[83051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:02 devstack sudo[83049]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced 1073741824" returned: 0 in 0.780s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:02 devstack sudo[83057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced
Apr 20 18:38:02 devstack sudo[83057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Acquiring lock "cinder-54e96810-3d83-4577-852b-fc5ec00fa840-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "cinder-54e96810-3d83-4577-852b-fc5ec00fa840-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:03 devstack sudo[83051]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.728s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Acquiring lock "cinder-quobyte-54e96810-3d83-4577-852b-fc5ec00fa840" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "cinder-quobyte-54e96810-3d83-4577-852b-fc5ec00fa840" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:03 devstack cinder-volume[82268]: INFO oslo.privsep.daemon [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptqhju3ze/privsep.sock']
Apr 20 18:38:03 devstack sudo[83060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptqhju3ze/privsep.sock
Apr 20 18:38:03 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 20 18:38:03 devstack sudo[83057]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.893s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6596c3dd-8fc1-4220-9270-ce844a23ee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcebd9b-173b-470b-ace8-85d8ea340ced', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28e4a4-c8e1-4e4e-9ee8-0999a3766c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Creating offline snapshot c531c177-2de5-43e4-bf22-040bf895320f of volume 8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:38:03 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Volume volume-5dcebd9b-173b-470b-ace8-85d8ea340ced (5dcebd9b-173b-470b-ace8-85d8ea340ced): created successfully
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28e4a4-c8e1-4e4e-9ee8-0999a3766c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Flow 'volume_create_manager' (00f4a5c7-7d46-420d-b4ab-245207bc1e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:03 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-2abde287-0894-412e-b804-20927151bbd8 req-203eb871-c14b-4faa-a979-543289c231ac tempest-VolumesGetTestJSON-756937906 None] Created volume successfully.
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 18:38:03 devstack cinder-volume[82268]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 20 18:38:04 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:04 devstack cinder-volume[82268]: INFO oslo.privsep.daemon [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Spawned new privsep daemon via rootwrap
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Accepted privsep connection to /tmp/tmptqhju3ze/privsep.sock {{(pid=82268) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 20 18:38:04 devstack cinder-volume[82268]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 20 18:38:04 devstack cinder-volume[82268]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 20 18:38:04 devstack cinder-volume[82268]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 20 18:38:04 devstack cinder-volume[82268]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83069
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc090d56-b38f-4028-87e6-a652cfe32b28]: (2,) {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:04 devstack cinder-volume[82268]: WARNING oslo_privsep.priv_context [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] privsep daemon already running
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98bbe4a-8a43-4dae-9499-5423b03b3c9b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe43861-3d33-458d-a466-7e64474c4d86]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:04 devstack sudo[83072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840
Apr 20 18:38:04 devstack sudo[83072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:04 devstack sudo[83073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d
Apr 20 18:38:04 devstack sudo[83073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Acquiring lock "cinder-5dcebd9b-173b-470b-ace8-85d8ea340ced-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Lock "cinder-5dcebd9b-173b-470b-ace8-85d8ea340ced-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Acquiring lock "cinder-quobyte-5dcebd9b-173b-470b-ace8-85d8ea340ced" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Lock "cinder-quobyte-5dcebd9b-173b-470b-ace8-85d8ea340ced" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e4765-b760-4ad5-961a-cde1c51fa6af]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:04 devstack sudo[83078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced
Apr 20 18:38:04 devstack sudo[83078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:04 devstack sudo[83072]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:04 devstack sudo[83084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840
Apr 20 18:38:04 devstack sudo[83084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:04 devstack sudo[83073]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d" returned: 0 in 0.711s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:04 devstack sudo[83089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f 1G
Apr 20 18:38:04 devstack sudo[83089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:05 devstack sudo[83078]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced" returned: 0 in 0.607s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:05 devstack sudo[83084]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:05 devstack sudo[83098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced
Apr 20 18:38:05 devstack sudo[83098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54e96810-3d83-4577-852b-fc5ec00fa840" returned: 0 in 0.480s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "cinder-quobyte-54e96810-3d83-4577-852b-fc5ec00fa840" released by "delete_volume" :: held 2.018s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:05 devstack cinder-volume[82268]: WARNING cinder.quota [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:05 devstack cinder-volume[82268]: WARNING cinder.quota [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Created reservations ['306becce-09d8-4102-9cf4-a27f71f5e32f', '93273631-207f-47d4-8383-3e7932b3e342', '1d259bc0-e8b4-47fc-bfbd-49d54497f6bb', '1176bf37-f7eb-43ab-ba4a-eb033fc47994'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:05 devstack sudo[83100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:05 devstack sudo[83100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:05 devstack sudo[83089]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f 1G" returned: 0 in 0.970s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb17eac-e429-4cbc-877b-926f2941339d -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:05 devstack sudo[83100]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.610s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Deleted volume successfully.
Apr 20 18:38:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8f0b304e-c7ab-4a92-bb2c-a9440b2bf288 tempest-VolumesAdminNegativeTest-1150271080 None] Lock "cinder-54e96810-3d83-4577-852b-fc5ec00fa840-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:05 devstack sudo[83135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb17eac-e429-4cbc-877b-926f2941339d -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f
Apr 20 18:38:05 devstack sudo[83135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:06 devstack sudo[83098]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5dcebd9b-173b-470b-ace8-85d8ea340ced" returned: 0 in 1.016s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Lock "cinder-quobyte-5dcebd9b-173b-470b-ace8-85d8ea340ced" released by "delete_volume" :: held 1.653s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG cinder.quota [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Created reservations ['4a428e51-bbb1-45e5-8120-01275dae18dd', '4a765cd7-dc89-4487-b854-5b94044ea1aa', '83475fc4-2804-4511-857f-48ea2fd11edb', '3e6f72d1-5e1b-41c0-9f12-be114c80b0e3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:06 devstack sudo[83142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:06 devstack sudo[83142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:06 devstack sudo[83142]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.484s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG cinder.manager [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Deleted volume successfully.
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-06e3e166-fcfd-439c-8bf3-437b1279a040 req-1f0c9e57-43e6-43d1-8588-a5c0a3feed11 tempest-VolumesGetTestJSON-756937906 None] Lock "cinder-5dcebd9b-173b-470b-ace8-85d8ea340ced-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:06 devstack sudo[83135]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fb17eac-e429-4cbc-877b-926f2941339d -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f" returned: 0 in 1.111s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:06 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f is being set with open permissions: ugo+rw
Apr 20 18:38:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:06 devstack sudo[83154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f
Apr 20 18:38:06 devstack sudo[83154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:07 devstack sudo[83154]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f" returned: 0 in 0.703s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:07 devstack sudo[83181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info
Apr 20 18:38:07 devstack sudo[83181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Flow 'volume_create_manager' (a281aa57-d621-45c6-9aad-b73f94687acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef07c5a-0b72-462c-9948-457d5d3b6a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef07c5a-0b72-462c-9948-457d5d3b6a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-512025488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e09a823-a690-4951-9a6c-5b151a858a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dc348f889f40e5b398889563cfa158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:08Z,use_quota=True,user_id='1a8f2154a67c405d864cd614b4172358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e8b74-89b2-46b3-b18f-7b1ed9c0c586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e8b74-89b2-46b3-b18f-7b1ed9c0c586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52cf99db-1f52-41e8-88ab-689a77acadb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52cf99db-1f52-41e8-88ab-689a77acadb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e09a823-a690-4951-9a6c-5b151a858a15', 'volume_name': 'volume-5e09a823-a690-4951-9a6c-5b151a858a15', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dd5080-d42a-40f0-9256-a05872fdda52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dd5080-d42a-40f0-9256-a05872fdda52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a266e7ec-a85d-4cfc-9e8b-400174016367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Volume 5e09a823-a690-4951-9a6c-5b151a858a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e09a823-a690-4951-9a6c-5b151a858a15', 'volume_size': 1}
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:08 devstack sudo[83181]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info" returned: 0 in 0.901s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:08 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info is being set with open permissions: ugo+rw
Apr 20 18:38:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:08 devstack sudo[83200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info
Apr 20 18:38:08 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:09 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.info" returned: 0 in 0.435s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.602s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.581s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-512025488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e09a823-a690-4951-9a6c-5b151a858a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08dc348f889f40e5b398889563cfa158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:08Z,use_quota=True,user_id='1a8f2154a67c405d864cd614b4172358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Creating volume 5e09a823-a690-4951-9a6c-5b151a858a15 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:09 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:09 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-b8de8fd0-5e01-4bbe-9c95-7bdecddd0806 req-0d2c13a0-5e9b-4f39-b04f-f5056ceca074 tempest-VolumesSnapshotsTestJSON-708154095 None] Create snapshot completed successfully
Apr 20 18:38:09 devstack sudo[83204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 1073741824
Apr 20 18:38:09 devstack sudo[83204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "cinder-c531c177-2de5-43e4-bf22-040bf895320f-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-c531c177-2de5-43e4-bf22-040bf895320f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "cinder-quobyte-8fb17eac-e429-4cbc-877b-926f2941339d" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-quobyte-8fb17eac-e429-4cbc-877b-926f2941339d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "cinder-quobyte-c531c177-2de5-43e4-bf22-040bf895320f" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-quobyte-c531c177-2de5-43e4-bf22-040bf895320f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Deleting offline snapshot c531c177-2de5-43e4-bf22-040bf895320f of volume 8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] snapshot_file for this snap is: volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4c2a9-4621-4657-be38-128c7405dcdb]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:09 devstack sudo[83208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f
Apr 20 18:38:09 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:09 devstack sudo[83204]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 1073741824" returned: 0 in 0.653s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:09 devstack sudo[83213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15
Apr 20 18:38:09 devstack sudo[83213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:10 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fb17eac-e429-4cbc-877b-926f2941339d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cff97f-d10c-4d96-a336-1d7ed62dc71c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:10 devstack sudo[83222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d
Apr 20 18:38:10 devstack sudo[83222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:10 devstack sudo[83213]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a266e7ec-a85d-4cfc-9e8b-400174016367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e09a823-a690-4951-9a6c-5b151a858a15', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bc8896-bfd6-45d8-bd3e-4417b43b351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:10 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Volume volume-5e09a823-a690-4951-9a6c-5b151a858a15 (5e09a823-a690-4951-9a6c-5b151a858a15): created successfully
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bc8896-bfd6-45d8-bd3e-4417b43b351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Flow 'volume_create_manager' (a281aa57-d621-45c6-9aad-b73f94687acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-21051fc0-571b-455f-9000-70d4a00874e8 tempest-DeleteServersTestJSON-1267309235 None] Created volume successfully.
Apr 20 18:38:10 devstack sudo[83222]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d" returned: 0 in 0.522s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:10 devstack sudo[83230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f
Apr 20 18:38:10 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7952fcdb-3838-4f9d-a8af-83518770946b tempest-BackendsCapabilitiesAdminTestsJSON-1669206350 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82268) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 20 18:38:11 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:11 devstack sudo[83241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f
Apr 20 18:38:11 devstack sudo[83241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:11 devstack sudo[83241]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-872ee1ea-ec29-49b0-b246-1efafcb1459d tempest-BackendsCapabilitiesAdminTestsJSON-1669206350 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82268) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d.c531c177-2de5-43e4-bf22-040bf895320f" returned: 0 in 0.437s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-quobyte-c531c177-2de5-43e4-bf22-040bf895320f" released by "_delete_snapshot" :: held 2.052s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-quobyte-8fb17eac-e429-4cbc-877b-926f2941339d" released by "delete_snapshot" :: held 2.068s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:11 devstack cinder-volume[82268]: WARNING cinder.quota [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.quota [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Created reservations ['21892ded-0984-433e-b2c3-9bf679f16df3', 'ad6b7a55-055f-4848-a54e-756f7d993360', 'ba2d2499-7137-4cdc-b703-4c874c37773e', 'b4aa806e-36de-4356-99e0-d94144d82405'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Delete snapshot completed successfully.
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-3396d1c6-b504-4816-a8dc-9425807c714c req-102ec82e-c94e-470a-b1ab-176e60608336 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-c531c177-2de5-43e4-bf22-040bf895320f-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "cinder-8fb17eac-e429-4cbc-877b-926f2941339d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-8fb17eac-e429-4cbc-877b-926f2941339d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "cinder-quobyte-8fb17eac-e429-4cbc-877b-926f2941339d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-quobyte-8fb17eac-e429-4cbc-877b-926f2941339d" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b50ef-a602-472a-95cb-68a26498befa]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:12 devstack sudo[83244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d
Apr 20 18:38:12 devstack sudo[83244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:12 devstack sudo[83244]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d" returned: 0 in 0.615s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:12 devstack sudo[83249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d
Apr 20 18:38:12 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:13 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8fb17eac-e429-4cbc-877b-926f2941339d" returned: 0 in 0.767s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-quobyte-8fb17eac-e429-4cbc-877b-926f2941339d" released by "delete_volume" :: held 1.413s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG cinder.quota [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Created reservations ['e03facf6-9663-4df2-8350-1c34a9f3e2f1', 'f021e781-b55a-471d-a03b-907f3aca65ba', '38b75210-57b7-4cdb-8e47-b76460656b7b', '42192219-e30d-4386-93b2-13ef83d03409'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:13 devstack sudo[83253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:13 devstack sudo[83253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:14 devstack sudo[83253]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.618s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:14 devstack cinder-volume[82268]: DEBUG cinder.manager [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Deleted volume successfully.
Apr 20 18:38:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-87690ea4-68b8-4b23-97fe-f6538e4a9449 req-d2045649-76ee-4db5-bd98-3de5b55c9383 tempest-VolumesSnapshotsTestJSON-708154095 None] Lock "cinder-8fb17eac-e429-4cbc-877b-926f2941339d-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:16 devstack cinder-volume[82268]: WARNING py.warnings [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 20 18:38:16 devstack cinder-volume[82268]:   .first()
Apr 20 18:38:16 devstack cinder-volume[82268]: 
Apr 20 18:38:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:16 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4271437-aa28-4979-8899-5360cac92767]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:16 devstack sudo[83307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15
Apr 20 18:38:16 devstack sudo[83307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:17 devstack sudo[83307]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15" returned: 0 in 0.760s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba', 'name': 'volume-5e09a823-a690-4951-9a6c-5b151a858a15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '662c35ac-fec2-46da-8394-75de9ee5acb9', 'enforce_multipath': True} {{(pid=82268) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 18:38:17 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-9956eaa1-ffc0-43a6-a287-023d9a74f9ff req-6bbf650a-c5ef-43e0-91e5-d4428bcf2582 tempest-DeleteServersTestJSON-1267309235 None] attachment_update completed successfully.
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Flow 'volume_create_manager' (8211b360-6c98-4c1f-8682-b6c80b4dce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323e26c5-de4c-4461-89ca-ab8d537e011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323e26c5-de4c-4461-89ca-ab8d537e011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239198005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c5f8df-ba23-4817-b32c-7406663af6a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec0ec04d1a7044dfb14fe0e7bd8dcec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:18Z,use_quota=True,user_id='7dd35fff5f1a41168fa9907ce730383c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147cb060-4bc1-43a9-aa14-d2b0e1676540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147cb060-4bc1-43a9-aa14-d2b0e1676540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5284b4ae-e203-49bf-9c2f-729dcd4faa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5284b4ae-e203-49bf-9c2f-729dcd4faa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c5f8df-ba23-4817-b32c-7406663af6a1', 'volume_name': 'volume-72c5f8df-ba23-4817-b32c-7406663af6a1', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc0ee3f-d311-4c8c-806c-41f0a4c5ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc0ee3f-d311-4c8c-806c-41f0a4c5ef93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28320be1-691f-46d8-8944-e9943dfde4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:18 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Volume 72c5f8df-ba23-4817-b32c-7406663af6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c5f8df-ba23-4817-b32c-7406663af6a1', 'volume_size': 1}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239198005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c5f8df-ba23-4817-b32c-7406663af6a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec0ec04d1a7044dfb14fe0e7bd8dcec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:18Z,use_quota=True,user_id='7dd35fff5f1a41168fa9907ce730383c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Creating volume 72c5f8df-ba23-4817-b32c-7406663af6a1 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:18 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:18 devstack sudo[83382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1 1073741824
Apr 20 18:38:18 devstack sudo[83382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:19 devstack sudo[83382]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1 1073741824" returned: 0 in 0.672s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:19 devstack sudo[83705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1
Apr 20 18:38:19 devstack sudo[83705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:19 devstack sudo[83705]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1" returned: 0 in 0.591s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28320be1-691f-46d8-8944-e9943dfde4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c5f8df-ba23-4817-b32c-7406663af6a1', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12ab6ac-7e74-437c-b6aa-21330115e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:19 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Volume volume-72c5f8df-ba23-4817-b32c-7406663af6a1 (72c5f8df-ba23-4817-b32c-7406663af6a1): created successfully
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12ab6ac-7e74-437c-b6aa-21330115e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Flow 'volume_create_manager' (8211b360-6c98-4c1f-8682-b6c80b4dce0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:19 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ea8493b6-3561-4db5-83f8-21d381936e90 tempest-VolumesTestJSON-1167953349 None] Created volume successfully.
Apr 20 18:38:20 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5f248961-267f-4543-9101-dc41650a5adb tempest-GroupsTest-35391181 None] Group tempest-Group1-306303485: creating
Apr 20 18:38:20 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5f248961-267f-4543-9101-dc41650a5adb tempest-GroupsTest-35391181 None] Group tempest-Group1-306303485: created successfully
Apr 20 18:38:20 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5f248961-267f-4543-9101-dc41650a5adb tempest-GroupsTest-35391181 None] Create group completed successfully.
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Flow 'volume_create_manager' (c4b6067e-1749-4d1a-b6d5-893f905890da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c65e77-9cc9-4442-ab84-24ecc00e4f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c65e77-9cc9-4442-ab84-24ecc00e4f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1522270689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e7bb0c-4b9a-4532-aa82-7cb476497fc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec0ec04d1a7044dfb14fe0e7bd8dcec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:21Z,use_quota=True,user_id='7dd35fff5f1a41168fa9907ce730383c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f972edb0-1fc0-41fd-83f7-751650dcfb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f972edb0-1fc0-41fd-83f7-751650dcfb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79b63e7-9800-4275-86f6-e8ba2964f44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79b63e7-9800-4275-86f6-e8ba2964f44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e7bb0c-4b9a-4532-aa82-7cb476497fc9', 'volume_name': 'volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9a0579-89ce-470d-a0cd-e2a19e7cb502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9a0579-89ce-470d-a0cd-e2a19e7cb502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83568ad0-0131-4d68-9c83-bf923e36caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:20 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Volume b9e7bb0c-4b9a-4532-aa82-7cb476497fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9', 'volume_size': 1}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1522270689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e7bb0c-4b9a-4532-aa82-7cb476497fc9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec0ec04d1a7044dfb14fe0e7bd8dcec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:21Z,use_quota=True,user_id='7dd35fff5f1a41168fa9907ce730383c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Creating volume b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:20 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:20 devstack sudo[83710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 1073741824
Apr 20 18:38:20 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:21 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 1073741824" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:21 devstack sudo[83715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9
Apr 20 18:38:21 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-86121944-7d5b-4435-bc08-298985a5bd20 tempest-GroupsTest-35391181 None] Group tempest-Group2-713255020: creating
Apr 20 18:38:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-86121944-7d5b-4435-bc08-298985a5bd20 tempest-GroupsTest-35391181 None] Group tempest-Group2-713255020: created successfully
Apr 20 18:38:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-86121944-7d5b-4435-bc08-298985a5bd20 tempest-GroupsTest-35391181 None] Create group completed successfully.
Apr 20 18:38:21 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9" returned: 0 in 0.640s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83568ad0-0131-4d68-9c83-bf923e36caf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43d371d-05b8-4fb8-865a-ed87c0dbdebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Volume volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 (b9e7bb0c-4b9a-4532-aa82-7cb476497fc9): created successfully
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43d371d-05b8-4fb8-865a-ed87c0dbdebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Flow 'volume_create_manager' (c4b6067e-1749-4d1a-b6d5-893f905890da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:22 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a7bf486c-9b33-4929-a926-295b052a3fa6 tempest-VolumesTestJSON-1167953349 None] Created volume successfully.
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Flow 'volume_create_manager' (3a510def-8221-410e-b9c1-7a92edfc3eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af1f841-202e-494d-8719-fda110b36824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af1f841-202e-494d-8719-fda110b36824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53897500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=16ad0276-6f80-4af7-b3bd-66ba48958497,host='devstack@QuobyteHD#QuobyteHD',id=20a45290-d48e-437f-adfa-3c6b872837fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d672b231a77f42e18668d96b0cd29cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:23Z,use_quota=True,user_id='17391ae08f7446648b78c712cc8fc1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93431c37-6b16-4c5a-ab15-a4e921cc5cc8),volume_type_id=93431c37-6b16-4c5a-ab15-a4e921cc5cc8)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09506d19-cf7c-4b31-8589-16377cb86ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09506d19-cf7c-4b31-8589-16377cb86ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad6a2cf-26d8-4e2b-b185-94221c075656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad6a2cf-26d8-4e2b-b185-94221c075656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a45290-d48e-437f-adfa-3c6b872837fc', 'volume_name': 'volume-20a45290-d48e-437f-adfa-3c6b872837fc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda0018e-f1ca-42cb-803c-bf0701924060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda0018e-f1ca-42cb-803c-bf0701924060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59389d8-6be1-44e4-ad4a-3ce854fdce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Volume 20a45290-d48e-437f-adfa-3c6b872837fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a45290-d48e-437f-adfa-3c6b872837fc', 'volume_size': 1}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=16ad0276-6f80-4af7-b3bd-66ba48958497,created_at=2026-04-20T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53897500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=16ad0276-6f80-4af7-b3bd-66ba48958497,host='devstack@QuobyteHD#QuobyteHD',id=20a45290-d48e-437f-adfa-3c6b872837fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d672b231a77f42e18668d96b0cd29cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:23Z,use_quota=True,user_id='17391ae08f7446648b78c712cc8fc1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93431c37-6b16-4c5a-ab15-a4e921cc5cc8),volume_type_id=93431c37-6b16-4c5a-ab15-a4e921cc5cc8)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Creating volume 20a45290-d48e-437f-adfa-3c6b872837fc {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:22 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:23 devstack sudo[83728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc 1073741824
Apr 20 18:38:23 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Flow 'volume_create_manager' (1542da01-253a-4e47-8e5c-24c47353528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e03835-0a94-4f11-97ad-a739717b5914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e03835-0a94-4f11-97ad-a739717b5914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-74500583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54e0d7b-eb4f-4bd5-a965-e971a085bf8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec0ec04d1a7044dfb14fe0e7bd8dcec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:23Z,use_quota=True,user_id='7dd35fff5f1a41168fa9907ce730383c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52d31a2-d2ca-4467-a6c9-1a3f65156c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52d31a2-d2ca-4467-a6c9-1a3f65156c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1a53e8-89e3-4a11-91f9-5edf7be5406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1a53e8-89e3-4a11-91f9-5edf7be5406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54e0d7b-eb4f-4bd5-a965-e971a085bf8d', 'volume_name': 'volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c644bd3-ad94-481c-a328-eaa9b14972d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c644bd3-ad94-481c-a328-eaa9b14972d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f541fed-9758-4aad-8a03-947454acace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Volume b54e0d7b-eb4f-4bd5-a965-e971a085bf8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d', 'volume_size': 1}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:23 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc 1073741824" returned: 0 in 0.706s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:23 devstack sudo[83780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc
Apr 20 18:38:23 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:24 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc" returned: 0 in 0.453s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-74500583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54e0d7b-eb4f-4bd5-a965-e971a085bf8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ec0ec04d1a7044dfb14fe0e7bd8dcec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:23Z,use_quota=True,user_id='7dd35fff5f1a41168fa9907ce730383c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Creating volume b54e0d7b-eb4f-4bd5-a965-e971a085bf8d {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:24 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59389d8-6be1-44e4-ad4a-3ce854fdce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a45290-d48e-437f-adfa-3c6b872837fc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:24 devstack sudo[83784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d 1073741824
Apr 20 18:38:24 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e785407-5ceb-4b4c-ad04-7cac7389ef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:24 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Volume volume-20a45290-d48e-437f-adfa-3c6b872837fc (20a45290-d48e-437f-adfa-3c6b872837fc): created successfully
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e785407-5ceb-4b4c-ad04-7cac7389ef6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Flow 'volume_create_manager' (3a510def-8221-410e-b9c1-7a92edfc3eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:24 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ee8fbc61-6fe5-4c09-82f5-cd66173d0583 tempest-GroupsTest-35391181 None] Created volume successfully.
Apr 20 18:38:24 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d 1073741824" returned: 0 in 0.617s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:24 devstack sudo[83790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d
Apr 20 18:38:24 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:25 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d" returned: 0 in 0.440s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f541fed-9758-4aad-8a03-947454acace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed208b2-a108-42ce-8731-d5d7053ba2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:25 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Volume volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d (b54e0d7b-eb4f-4bd5-a965-e971a085bf8d): created successfully
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed208b2-a108-42ce-8731-d5d7053ba2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Flow 'volume_create_manager' (1542da01-253a-4e47-8e5c-24c47353528b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-fcaaadb3-9d98-4008-9200-01abe1f3395f tempest-VolumesTestJSON-1167953349 None] Created volume successfully.
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Acquiring lock "cinder-quobyte-20a45290-d48e-437f-adfa-3c6b872837fc" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Lock "cinder-quobyte-20a45290-d48e-437f-adfa-3c6b872837fc" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171fefa-c235-4db6-989c-a71ee5c192ec]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-4f1301e7-4b81-458f-830a-563c704794cb req-e10a5fe9-33a4-40d3-a1cf-f0c261f52dc1 tempest-DeleteServersTestJSON-1267309235 None] Terminate volume connection completed successfully.
Apr 20 18:38:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-4f1301e7-4b81-458f-830a-563c704794cb req-e10a5fe9-33a4-40d3-a1cf-f0c261f52dc1 tempest-DeleteServersTestJSON-1267309235 None] Deleting attachment 662c35ac-fec2-46da-8394-75de9ee5acb9. {{(pid=82268) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 18:38:25 devstack sudo[83794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc
Apr 20 18:38:25 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:26 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc" returned: 0 in 0.580s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:26 devstack sudo[83799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc
Apr 20 18:38:26 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "cinder-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "cinder-quobyte-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-quobyte-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf66aaf-0b6f-479a-bd9c-8aab9c16fb33]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:26 devstack sudo[83801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d
Apr 20 18:38:26 devstack sudo[83801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:26 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20a45290-d48e-437f-adfa-3c6b872837fc" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Lock "cinder-quobyte-20a45290-d48e-437f-adfa-3c6b872837fc" released by "delete_volume" :: held 1.069s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Created reservations ['28125d3f-919c-4084-8752-f3d1fd8f16e4'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:26 devstack cinder-volume[82268]: WARNING cinder.quota [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-255770983 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-255770983, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:26 devstack cinder-volume[82268]: WARNING cinder.quota [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-255770983 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-255770983, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Created reservations ['16be9191-277d-4682-a5d2-1368376095f8', 'e2739acf-ec35-4562-82a2-d30877062775', 'c5cf9ea2-af6e-458e-a2bb-6bb2fa66684e', '192636bb-2c8b-458f-9c11-292ef9d37a50'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:26 devstack sudo[83804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:26 devstack sudo[83804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:26 devstack sudo[83801]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d" returned: 0 in 0.591s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:26 devstack sudo[83809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d
Apr 20 18:38:26 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:27 devstack sudo[83804]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8c071a94-e4b5-46fa-96f2-4cedd6f81f8e tempest-GroupsTest-35391181 None] Delete group completed successfully.
Apr 20 18:38:27 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d" returned: 0 in 0.503s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-quobyte-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d" released by "delete_volume" :: held 1.114s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Created reservations ['3f8ff0c3-234f-4d38-a4f3-4f84f28e5aac', 'c7740a1f-5891-429b-8295-16007e03e356', '502242c7-f70b-4054-991a-57cf39670ee5', 'e53384ef-d103-484c-ad85-f17af9c486a8'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:27 devstack sudo[83813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:27 devstack sudo[83813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Created reservations ['c6bd5aa7-079a-4fb1-894f-eb7be2ca0fba'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:27 devstack sudo[83816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:27 devstack sudo[83816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:27 devstack sudo[83813]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Deleted volume successfully.
Apr 20 18:38:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3d019b7b-3b7d-4f98-ab13-86e513d39149 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-b54e0d7b-eb4f-4bd5-a965-e971a085bf8d-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:28 devstack sudo[83816]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-72acc0c6-325f-4c72-b8fa-f2176eaa8257 tempest-GroupsTest-35391181 None] Delete group completed successfully.
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "cinder-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "cinder-quobyte-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-quobyte-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d97284c-cb12-471e-aae0-c289b7dffae5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:28 devstack sudo[83819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9
Apr 20 18:38:28 devstack sudo[83819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:29 devstack sudo[83819]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9" returned: 0 in 0.535s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:29 devstack sudo[83824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9
Apr 20 18:38:29 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Acquiring lock "cinder-5e09a823-a690-4951-9a6c-5b151a858a15-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Lock "cinder-5e09a823-a690-4951-9a6c-5b151a858a15-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Acquiring lock "cinder-quobyte-5e09a823-a690-4951-9a6c-5b151a858a15" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Lock "cinder-quobyte-5e09a823-a690-4951-9a6c-5b151a858a15" acquired by "delete_volume" :: waited 0.024s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952b223-9cdf-46fd-87b5-a0b4ae293e76]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:29 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9" returned: 0 in 0.520s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-quobyte-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9" released by "delete_volume" :: held 1.085s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Created reservations ['f17dd865-a97a-45b0-8d5f-f90f4b971374', 'fe8ff68d-4644-401e-b73f-a575b5d428a4', '3cacc73f-0bf1-4ff4-be3b-2976b27863e7', 'd4961cb7-9aeb-468d-bca1-4048d2195780'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:29 devstack sudo[83827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15
Apr 20 18:38:29 devstack sudo[83827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-89837f0f-96a5-4ead-83af-ace3522a6415 tempest-GroupsTest-35391181 None] Group tempest-GroupsTest-Group-780761274: creating
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-89837f0f-96a5-4ead-83af-ace3522a6415 tempest-GroupsTest-35391181 None] Group tempest-GroupsTest-Group-780761274: created successfully
Apr 20 18:38:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-89837f0f-96a5-4ead-83af-ace3522a6415 tempest-GroupsTest-35391181 None] Create group completed successfully.
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Acquiring lock "cinder-72c5f8df-ba23-4817-b32c-7406663af6a1-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Lock "cinder-72c5f8df-ba23-4817-b32c-7406663af6a1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:29 devstack sudo[83829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:29 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Acquiring lock "cinder-quobyte-72c5f8df-ba23-4817-b32c-7406663af6a1" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Lock "cinder-quobyte-72c5f8df-ba23-4817-b32c-7406663af6a1" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4901dc3e-21af-4ad3-afd3-6b4fa79c6422]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:29 devstack sudo[83831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1
Apr 20 18:38:29 devstack sudo[83831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:30 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:30 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Deleted volume successfully.
Apr 20 18:38:30 devstack sudo[83827]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15" returned: 0 in 0.628s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7114f546-4fe3-4986-a4f2-ae76cc1e73e9 tempest-VolumesTestJSON-1167953349 None] Lock "cinder-b9e7bb0c-4b9a-4532-aa82-7cb476497fc9-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:30 devstack sudo[83837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15
Apr 20 18:38:30 devstack sudo[83837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:30 devstack sudo[83831]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1" returned: 0 in 0.557s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:30 devstack sudo[83842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1
Apr 20 18:38:30 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:30 devstack sudo[83837]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5e09a823-a690-4951-9a6c-5b151a858a15" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Lock "cinder-quobyte-5e09a823-a690-4951-9a6c-5b151a858a15" released by "delete_volume" :: held 1.147s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Created reservations ['c56e0a1d-7df2-49f2-aad1-b2b6811b6191', 'e80a4149-853c-449d-87b3-3c43950f25af', '2bbe096b-846d-4013-966a-801e551a0ec9', '647d5c08-2448-4168-8e03-702e2051492e'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:30 devstack sudo[83846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:30 devstack sudo[83846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:30 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-72c5f8df-ba23-4817-b32c-7406663af6a1" returned: 0 in 0.482s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Lock "cinder-quobyte-72c5f8df-ba23-4817-b32c-7406663af6a1" released by "delete_volume" :: held 1.077s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Created reservations ['f353f235-a02a-4cb0-9c08-4cb628d20bf2', '608b6b60-3a30-49f2-b1e3-e41e68a6b60e', '6c42ad40-308b-427c-b496-0d32be360b1a', 'd21d01f7-c5bd-4cef-880b-c153c313181d'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:30 devstack sudo[83849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:30 devstack sudo[83849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Flow 'volume_create_manager' (24646b0e-a287-4301-ae9c-4aaf78f63215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ea9e1-473b-48d4-b418-f6b177d356b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ea9e1-473b-48d4-b418-f6b177d356b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1008525807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07d5c90d-474c-4192-a72b-b2305c97dc38,host='devstack@QuobyteHD#QuobyteHD',id=a6f437ec-a01e-4977-9dcd-f3698c7d17f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d672b231a77f42e18668d96b0cd29cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:31Z,use_quota=True,user_id='17391ae08f7446648b78c712cc8fc1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c87a1fc0-3ad8-4a28-9762-1076118127f7),volume_type_id=c87a1fc0-3ad8-4a28-9762-1076118127f7)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd38fb60-015f-48d7-9674-b300f7361566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd38fb60-015f-48d7-9674-b300f7361566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4d2b3a-37ce-41d8-8e81-7b508c6cbc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4d2b3a-37ce-41d8-8e81-7b508c6cbc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f437ec-a01e-4977-9dcd-f3698c7d17f7', 'volume_name': 'volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f57980d-b0d6-4769-8fce-eb87410c083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f57980d-b0d6-4769-8fce-eb87410c083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34863617-2f8d-47d1-ae19-8d14de05291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Volume a6f437ec-a01e-4977-9dcd-f3698c7d17f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7', 'volume_size': 1}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07d5c90d-474c-4192-a72b-b2305c97dc38,created_at=2026-04-20T16:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1008525807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07d5c90d-474c-4192-a72b-b2305c97dc38,host='devstack@QuobyteHD#QuobyteHD',id=a6f437ec-a01e-4977-9dcd-f3698c7d17f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d672b231a77f42e18668d96b0cd29cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:31Z,use_quota=True,user_id='17391ae08f7446648b78c712cc8fc1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c87a1fc0-3ad8-4a28-9762-1076118127f7),volume_type_id=c87a1fc0-3ad8-4a28-9762-1076118127f7)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Creating volume a6f437ec-a01e-4977-9dcd-f3698c7d17f7 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:31 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:31 devstack sudo[83851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 1073741824
Apr 20 18:38:31 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:31 devstack sudo[83846]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.562s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:31 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Deleted volume successfully.
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0d68ff6d-70f2-4b58-87ff-69af949b17c5 tempest-DeleteServersTestJSON-1267309235 None] Lock "cinder-5e09a823-a690-4951-9a6c-5b151a858a15-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:31 devstack sudo[83849]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.488s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:31 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Deleted volume successfully.
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e47dfab-fbb6-4e03-868d-81f91409eada tempest-VolumesTestJSON-1167953349 None] Lock "cinder-72c5f8df-ba23-4817-b32c-7406663af6a1-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:31 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 1073741824" returned: 0 in 0.577s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:31 devstack sudo[83858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7
Apr 20 18:38:31 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:32 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7" returned: 0 in 0.512s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34863617-2f8d-47d1-ae19-8d14de05291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88e742a-452e-4f15-aa44-016466436cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:32 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Volume volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 (a6f437ec-a01e-4977-9dcd-f3698c7d17f7): created successfully
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88e742a-452e-4f15-aa44-016466436cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Flow 'volume_create_manager' (24646b0e-a287-4301-ae9c-4aaf78f63215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7832502d-10c6-4ad6-b90d-8ae5d1c4ce87 tempest-GroupsTest-35391181 None] Created volume successfully.
Apr 20 18:38:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b89dbfc4-ed2c-4fc1-ba1d-ea032ebbfa89 tempest-GroupsV314Test-1464336664 None] Group tempest-GroupsV314Test-Group-441599481: creating
Apr 20 18:38:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b89dbfc4-ed2c-4fc1-ba1d-ea032ebbfa89 tempest-GroupsV314Test-1464336664 None] Group tempest-GroupsV314Test-Group-441599481: created successfully
Apr 20 18:38:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b89dbfc4-ed2c-4fc1-ba1d-ea032ebbfa89 tempest-GroupsV314Test-1464336664 None] Create group completed successfully.
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Flow 'volume_create_manager' (2d6b8ab0-9ac3-4b4a-9a8b-54867cadba37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e1346e-43ca-4dd5-b879-928f56d89e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e1346e-43ca-4dd5-b879-928f56d89e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533198615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07d5c90d-474c-4192-a72b-b2305c97dc38,host='devstack@QuobyteHD#QuobyteHD',id=d9f563f2-25b5-40ad-a171-191ac96be5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d672b231a77f42e18668d96b0cd29cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:34Z,use_quota=True,user_id='17391ae08f7446648b78c712cc8fc1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c87a1fc0-3ad8-4a28-9762-1076118127f7),volume_type_id=c87a1fc0-3ad8-4a28-9762-1076118127f7)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8da88b1-7523-4315-99e4-26fa51c387ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8da88b1-7523-4315-99e4-26fa51c387ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235b838a-c659-4863-a13c-1e2529af248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235b838a-c659-4863-a13c-1e2529af248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f563f2-25b5-40ad-a171-191ac96be5cb', 'volume_name': 'volume-d9f563f2-25b5-40ad-a171-191ac96be5cb', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28737034-6ab5-4761-a743-69dc53062faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28737034-6ab5-4761-a743-69dc53062faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff15586-d5a3-4863-ac6f-82fc6a2b7bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:33 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Volume d9f563f2-25b5-40ad-a171-191ac96be5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f563f2-25b5-40ad-a171-191ac96be5cb', 'volume_size': 1}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07d5c90d-474c-4192-a72b-b2305c97dc38,created_at=2026-04-20T16:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533198615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07d5c90d-474c-4192-a72b-b2305c97dc38,host='devstack@QuobyteHD#QuobyteHD',id=d9f563f2-25b5-40ad-a171-191ac96be5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d672b231a77f42e18668d96b0cd29cd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:34Z,use_quota=True,user_id='17391ae08f7446648b78c712cc8fc1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c87a1fc0-3ad8-4a28-9762-1076118127f7),volume_type_id=c87a1fc0-3ad8-4a28-9762-1076118127f7)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Creating volume d9f563f2-25b5-40ad-a171-191ac96be5cb {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:33 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:33 devstack sudo[83862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb 1073741824
Apr 20 18:38:33 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:34 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb 1073741824" returned: 0 in 0.619s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:34 devstack sudo[83867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb
Apr 20 18:38:34 devstack sudo[83867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Flow 'volume_create_manager' (5cf6f237-6b23-40ad-9cf8-d2cd1cb40b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a782d0-91c0-4250-ac8c-507f525031aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a782d0-91c0-4250-ac8c-507f525031aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1743715133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a8d013c-99ec-4460-be22-818288200a69,host='devstack@QuobyteHD#QuobyteHD',id=3f81d8e1-5860-40d5-980e-064effd89caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbd4ea1533947e2b908a52dda91e7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:34Z,use_quota=True,user_id='a05c299532384194a14bfd41b6b85930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05ff87ce-bc2f-43b4-ad76-d30b4b907825),volume_type_id=05ff87ce-bc2f-43b4-ad76-d30b4b907825)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c187435-615a-4d00-bddb-6dea593ba827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c187435-615a-4d00-bddb-6dea593ba827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c532edba-c83d-489a-81ea-494ae59701a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c532edba-c83d-489a-81ea-494ae59701a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f81d8e1-5860-40d5-980e-064effd89caf', 'volume_name': 'volume-3f81d8e1-5860-40d5-980e-064effd89caf', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2954396f-b730-4477-8e3a-d6597084342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2954396f-b730-4477-8e3a-d6597084342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e5ebf0-0bc7-4cd4-865b-ef422feba4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:34 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Volume 3f81d8e1-5860-40d5-980e-064effd89caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f81d8e1-5860-40d5-980e-064effd89caf', 'volume_size': 1}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ab9d8aa2-d137-4802-a7fa-e9aa0f7c5f50 tempest-GroupSnapshotsTest-895773677 None] Group tempest-GroupSnapshotsTest-Group-1422813620: creating
Apr 20 18:38:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ab9d8aa2-d137-4802-a7fa-e9aa0f7c5f50 tempest-GroupSnapshotsTest-895773677 None] Group tempest-GroupSnapshotsTest-Group-1422813620: created successfully
Apr 20 18:38:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ab9d8aa2-d137-4802-a7fa-e9aa0f7c5f50 tempest-GroupSnapshotsTest-895773677 None] Create group completed successfully.
Apr 20 18:38:34 devstack sudo[83867]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb" returned: 0 in 0.561s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8a8d013c-99ec-4460-be22-818288200a69,created_at=2026-04-20T16:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1743715133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a8d013c-99ec-4460-be22-818288200a69,host='devstack@QuobyteHD#QuobyteHD',id=3f81d8e1-5860-40d5-980e-064effd89caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbd4ea1533947e2b908a52dda91e7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:34Z,use_quota=True,user_id='a05c299532384194a14bfd41b6b85930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05ff87ce-bc2f-43b4-ad76-d30b4b907825),volume_type_id=05ff87ce-bc2f-43b4-ad76-d30b4b907825)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Creating volume 3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:34 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff15586-d5a3-4863-ac6f-82fc6a2b7bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f563f2-25b5-40ad-a171-191ac96be5cb', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d88e7c-1b60-4c2e-bca1-826228b8f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:34 devstack sudo[83871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf 1073741824
Apr 20 18:38:34 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:34 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Volume volume-d9f563f2-25b5-40ad-a171-191ac96be5cb (d9f563f2-25b5-40ad-a171-191ac96be5cb): created successfully
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d88e7c-1b60-4c2e-bca1-826228b8f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Flow 'volume_create_manager' (2d6b8ab0-9ac3-4b4a-9a8b-54867cadba37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:35 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e9f214fb-bfea-42a7-a596-2b0f5a502b0b tempest-GroupsTest-35391181 None] Created volume successfully.
Apr 20 18:38:35 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf 1073741824" returned: 0 in 0.518s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:35 devstack sudo[83876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:35 devstack sudo[83876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:35 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-df6fcfb4-9ac4-469d-864a-6eec2b3b01aa tempest-GroupsTest-35391181 None] Update group completed successfully.
Apr 20 18:38:35 devstack sudo[83876]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.484s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e5ebf0-0bc7-4cd4-865b-ef422feba4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f81d8e1-5860-40d5-980e-064effd89caf', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402d4427-5b1c-42ea-b755-5ccb42ef1456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:35 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Volume volume-3f81d8e1-5860-40d5-980e-064effd89caf (3f81d8e1-5860-40d5-980e-064effd89caf): created successfully
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402d4427-5b1c-42ea-b755-5ccb42ef1456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Flow 'volume_create_manager' (5cf6f237-6b23-40ad-9cf8-d2cd1cb40b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-284d3e46-1ec5-476e-96b3-5b8ea76357f3 tempest-GroupsV314Test-1464336664 None] Created volume successfully.
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (8eb9d132-14d1-442e-b701-8834273d0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0892beea-314f-4173-b2d0-8430e4773506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0892beea-314f-4173-b2d0-8430e4773506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1057624358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c6e9a1a-1f5f-4997-bfe0-ccb6eebd8063,host='devstack@QuobyteHD#QuobyteHD',id=9d11e877-7e79-4568-8129-a6a955941104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:36Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70a72f7e-73e6-4a71-8460-d78d9b8611db),volume_type_id=70a72f7e-73e6-4a71-8460-d78d9b8611db)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdad19b5-587e-41c4-8508-bdbf2ab9a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdad19b5-587e-41c4-8508-bdbf2ab9a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0ffbf8-a725-4717-98f8-65c4daee4f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0ffbf8-a725-4717-98f8-65c4daee4f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d11e877-7e79-4568-8129-a6a955941104', 'volume_name': 'volume-9d11e877-7e79-4568-8129-a6a955941104', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e69468f-02a5-4e2b-99a7-5464ddf80777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e69468f-02a5-4e2b-99a7-5464ddf80777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf54a19-d9e6-4cb6-90b3-a8efa66e64df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:36 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Volume 9d11e877-7e79-4568-8129-a6a955941104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d11e877-7e79-4568-8129-a6a955941104', 'volume_size': 1}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0c6e9a1a-1f5f-4997-bfe0-ccb6eebd8063,created_at=2026-04-20T16:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1057624358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0c6e9a1a-1f5f-4997-bfe0-ccb6eebd8063,host='devstack@QuobyteHD#QuobyteHD',id=9d11e877-7e79-4568-8129-a6a955941104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:36Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70a72f7e-73e6-4a71-8460-d78d9b8611db),volume_type_id=70a72f7e-73e6-4a71-8460-d78d9b8611db)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Creating volume 9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:36 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:36 devstack sudo[83879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 1073741824
Apr 20 18:38:36 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:36 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 1073741824" returned: 0 in 0.539s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:36 devstack sudo[83884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:38:36 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:37 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.428s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf54a19-d9e6-4cb6-90b3-a8efa66e64df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d11e877-7e79-4568-8129-a6a955941104', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9249fc6-f546-4c41-be76-622004f2a2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:37 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Volume volume-9d11e877-7e79-4568-8129-a6a955941104 (9d11e877-7e79-4568-8129-a6a955941104): created successfully
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9249fc6-f546-4c41-be76-622004f2a2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (8eb9d132-14d1-442e-b701-8834273d0e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:37 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0ce415b7-bc58-45ba-acd1-da82e248ebdc tempest-GroupSnapshotsTest-895773677 None] Created volume successfully.
Apr 20 18:38:37 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b46bd901-ece0-4112-9605-5357b6de9565 tempest-GroupsTest-35391181 None] Update group completed successfully.
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:37 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Cloning volume 3f81d8e1-5860-40d5-980e-064effd89caf to volume 21f97111-58c4-4edf-a260-a870435c2050
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Creating offline snapshot a182271f-48da-43b0-a382-5a2562be2ac5 of volume 3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4c3f68-bc0f-48b9-a8e8-6c3142ab4f35]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:37 devstack sudo[83887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:37 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:38 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:38 devstack sudo[83893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 1G
Apr 20 18:38:38 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] GroupSnapshot 031a2295-677b-420a-a1e9-a2b06a908277: creating.
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Group snapshot 031a2295-677b-420a-a1e9-a2b06a908277: creating. {{(pid=82268) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Acquiring lock "cinder-quobyte-a6f437ec-a01e-4977-9dcd-f3698c7d17f7" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Lock "cinder-quobyte-a6f437ec-a01e-4977-9dcd-f3698c7d17f7" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a127119-7b08-458c-a59b-63654c415454]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:38 devstack sudo[83896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7
Apr 20 18:38:38 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:38 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 1G" returned: 0 in 0.633s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81d8e1-5860-40d5-980e-064effd89caf -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:38 devstack sudo[83900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81d8e1-5860-40d5-980e-064effd89caf -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5
Apr 20 18:38:38 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:39 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:39 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f81d8e1-5860-40d5-980e-064effd89caf -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5" returned: 0 in 0.496s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7" returned: 0 in 0.683s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:39 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:39 devstack sudo[83908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5
Apr 20 18:38:39 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:39 devstack sudo[83909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7
Apr 20 18:38:39 devstack sudo[83909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:39 devstack sudo[83909]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a6f437ec-a01e-4977-9dcd-f3698c7d17f7" returned: 0 in 0.488s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:39 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5" returned: 0 in 0.503s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Lock "cinder-quobyte-a6f437ec-a01e-4977-9dcd-f3698c7d17f7" released by "delete_volume" :: held 1.214s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Acquiring lock "cinder-quobyte-d9f563f2-25b5-40ad-a171-191ac96be5cb" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Lock "cinder-quobyte-d9f563f2-25b5-40ad-a171-191ac96be5cb" acquired by "delete_volume" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[494e28d1-a1c3-45be-ba24-a9ad73a81e66]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:39 devstack sudo[83915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info
Apr 20 18:38:39 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:39 devstack sudo[83914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb
Apr 20 18:38:39 devstack sudo[83914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:40 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:40 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:40 devstack sudo[83914]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb" returned: 0 in 0.508s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:40 devstack sudo[83922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info
Apr 20 18:38:40 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:40 devstack sudo[83923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb
Apr 20 18:38:40 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:40 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d9f563f2-25b5-40ad-a171-191ac96be5cb" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Lock "cinder-quobyte-d9f563f2-25b5-40ad-a171-191ac96be5cb" released by "delete_volume" :: held 0.998s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Created reservations ['2b219047-8934-4358-8f60-86421f4ed633'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:40 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.info" returned: 0 in 0.594s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Acquiring lock "cinder-quobyte-21f97111-58c4-4edf-a260-a870435c2050" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:40 devstack cinder-volume[82268]: WARNING cinder.quota [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1638709326 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1638709326, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:40 devstack cinder-volume[82268]: WARNING cinder.quota [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1638709326 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1638709326, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-21f97111-58c4-4edf-a260-a870435c2050" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] snapshot: a182271f-48da-43b0-a382-5a2562be2ac5, volume: 21f97111-58c4-4edf-a260-a870435c2050,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5229db5a-b5d5-4b94-a974-5a4711118416]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:40 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Created reservations ['b37b03c3-ea84-4eb0-a54f-cd10ff9feace', 'a7673bee-5693-49fa-be4f-6650e2102419', '04fdbd7d-2df5-41ca-b240-a725581b7075', '0b3ee7c8-1e27-4515-8436-e75d51bf3fe0'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Created reservations ['b30f3248-f487-4a3f-9692-c9e37468779f', '400024a5-c662-4eb6-b6e3-5d093421c661', '21003215-eb1c-4dcd-b70e-048cf787982e', '410c75a5-681b-442a-b9b7-f8eef4e7070f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:41 devstack sudo[83929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5
Apr 20 18:38:41 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:41 devstack sudo[83931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:41 devstack sudo[83931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:41 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5" returned: 0 in 0.536s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81d8e1-5860-40d5-980e-064effd89caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220acfc-d040-4b61-bbf8-66725ebcfc73]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:41 devstack sudo[83931]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.451s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:41 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:41 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ba5d43f8-4022-48a8-a488-a7ae982bc666 tempest-GroupsTest-35391181 None] Delete group completed successfully.
Apr 20 18:38:41 devstack sudo[83937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:41 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:42 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.565s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:42 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:38:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:42 devstack sudo[83942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050
Apr 20 18:38:42 devstack sudo[83942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:44 devstack sudo[83942]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050" returned: 0 in 2.682s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:44 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e825c294-1e97-4f90-877e-2da05f87fd13]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:44 devstack sudo[83976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:44 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:45 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.724s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:38:45 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Converted 1024.00 MB image at 381.46 MB/s
Apr 20 18:38:45 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:45 devstack sudo[83981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050
Apr 20 18:38:45 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:45 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-21f97111-58c4-4edf-a260-a870435c2050" released by "_copy_volume_from_snapshot" :: held 5.012s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Acquiring lock "cinder-quobyte-a182271f-48da-43b0-a382-5a2562be2ac5" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-a182271f-48da-43b0-a382-5a2562be2ac5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Deleting offline snapshot a182271f-48da-43b0-a382-5a2562be2ac5 of volume 3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] snapshot_file for this snap is: volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b114b1-6c33-4975-ad2e-3f728eb3c52f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:46 devstack sudo[83984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5
Apr 20 18:38:46 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Flow 'volume_create_manager' (79885beb-ff21-4563-8543-97f48aac1bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef86939b-cd5e-47a7-b3d9-870daff04d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef86939b-cd5e-47a7-b3d9-870daff04d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1887899065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f73205-f783-4afc-a09a-77d52ec49605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09513efdc6844cf48602ddd950805e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:46Z,use_quota=True,user_id='2dd6a50926a54b40b6b40730b1cb4c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb15498-17ed-4a35-9227-cf72c387af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb15498-17ed-4a35-9227-cf72c387af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd89ad16-fa5c-4d18-a87c-08fd254421f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd89ad16-fa5c-4d18-a87c-08fd254421f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f73205-f783-4afc-a09a-77d52ec49605', 'volume_name': 'volume-05f73205-f783-4afc-a09a-77d52ec49605', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9839c9-7062-46e6-bd59-1882a4c16464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e9839c9-7062-46e6-bd59-1882a4c16464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ab5b78-35ea-40ff-a009-d6b342f6a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:46 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Volume 05f73205-f783-4afc-a09a-77d52ec49605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f73205-f783-4afc-a09a-77d52ec49605', 'volume_size': 1}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:46 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5" returned: 0 in 0.606s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f81d8e1-5860-40d5-980e-064effd89caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6403a3-bfc4-4fd7-8296-3cd84b2aea9c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:46 devstack sudo[83993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:46 devstack sudo[83993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:47 devstack sudo[83993]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.480s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:47 devstack sudo[84001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5
Apr 20 18:38:47 devstack sudo[84001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:47 devstack sudo[84001]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:47 devstack sudo[84006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5
Apr 20 18:38:47 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:48 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf.a182271f-48da-43b0-a382-5a2562be2ac5" returned: 0 in 0.441s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-a182271f-48da-43b0-a382-5a2562be2ac5" released by "_delete_snapshot" :: held 2.050s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.487s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.514s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Creating offline snapshot 8c9b2c47-8dd5-4f22-8465-59ce7af3571f of volume 9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2b23f-3980-427b-b436-8e2b8bb6f396]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:48 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-55a64cbb-0015-4d6e-a6ca-96930e2c56d6 tempest-GroupsV314Test-1464336664 None] Create group from source-group-8a8d013c-99ec-4460-be22-818288200a69 completed successfully.
Apr 20 18:38:48 devstack sudo[84009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:38:48 devstack sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:48 devstack sudo[84009]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.496s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:48 devstack sudo[84014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f 1G
Apr 20 18:38:48 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Acquiring lock "cinder-quobyte-21f97111-58c4-4edf-a260-a870435c2050" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-21f97111-58c4-4edf-a260-a870435c2050" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ae3d8-7840-47e3-84ac-28bb4bebd924]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:48 devstack sudo[84016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050
Apr 20 18:38:48 devstack sudo[84016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:49 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f 1G" returned: 0 in 0.518s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d11e877-7e79-4568-8129-a6a955941104 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:49 devstack sudo[84021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d11e877-7e79-4568-8129-a6a955941104 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f
Apr 20 18:38:49 devstack sudo[84021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:49 devstack sudo[84016]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050" returned: 0 in 0.490s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:49 devstack sudo[84026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050
Apr 20 18:38:49 devstack sudo[84026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:49 devstack sudo[84021]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d11e877-7e79-4568-8129-a6a955941104 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f" returned: 0 in 0.452s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:49 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:49 devstack sudo[84031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f
Apr 20 18:38:49 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:49 devstack sudo[84026]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-21f97111-58c4-4edf-a260-a870435c2050" returned: 0 in 0.402s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-21f97111-58c4-4edf-a260-a870435c2050" released by "delete_volume" :: held 0.912s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Created reservations ['48047a55-1eaa-4085-8347-ca8b8acc3856'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:49 devstack cinder-volume[82268]: WARNING cinder.quota [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-188999550 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-188999550, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:49 devstack cinder-volume[82268]: WARNING cinder.quota [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-188999550 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-188999550, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Created reservations ['ae889327-94be-4a21-83eb-84efee0707d9', '7f765fee-1ebd-4b91-b59b-1dfafb36afb8', '78a83694-b2b5-4245-a57a-164cc81a092e', '71a0c1d5-f175-4bbc-86c9-b237cdab57a3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:49 devstack sudo[84034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:49 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:50 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Acquiring lock "cinder-quobyte-3f81d8e1-5860-40d5-980e-064effd89caf" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:50 devstack sudo[84037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info
Apr 20 18:38:50 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-3f81d8e1-5860-40d5-980e-064effd89caf" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[550746e0-dcb2-429d-90dd-5afc2214a83f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:50 devstack sudo[84039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:50 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:50 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.538s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a8f24179-0813-4a13-b9e6-d7bc17ecbdda tempest-GroupsV314Test-1464336664 None] Delete group completed successfully.
Apr 20 18:38:50 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info" returned: 0 in 0.497s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:50 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:50 devstack sudo[84047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info
Apr 20 18:38:50 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:50 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.504s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:50 devstack sudo[84050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf
Apr 20 18:38:50 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:51 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.info" returned: 0 in 0.424s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.606s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1887899065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f73205-f783-4afc-a09a-77d52ec49605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09513efdc6844cf48602ddd950805e03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:38:46Z,use_quota=True,user_id='2dd6a50926a54b40b6b40730b1cb4c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Creating volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:51 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=132,cinder:UPDATE=136,cinder:DELETE=12,cinder:INSERT=33 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:38:51 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:51 devstack sudo[84054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 1073741824
Apr 20 18:38:51 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3f81d8e1-5860-40d5-980e-064effd89caf" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Lock "cinder-quobyte-3f81d8e1-5860-40d5-980e-064effd89caf" released by "delete_volume" :: held 1.076s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=174,cinder:SELECT=145,cinder:INSERT=35,cinder:DELETE=8 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:38:51 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c82892af-e406-4fc9-ad76-1e91790e53cd tempest-GroupSnapshotsTest-895773677 None] group_snapshot 031a2295-677b-420a-a1e9-a2b06a908277: created successfully
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Created reservations ['008f9528-96ad-4559-9809-61edec11b348'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Created reservations ['3c07b42f-1b6c-4ecd-8b83-46e97d384ef3', '34691436-a7b4-4593-9d3a-7d114e26c877', '9a4442d3-e695-4798-a494-d86c8a0f9edc', 'f749eb9c-845f-47cd-a83e-10117b545950'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:51 devstack sudo[84056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:38:51 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:51 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 1073741824" returned: 0 in 0.545s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:51 devstack sudo[84061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605
Apr 20 18:38:51 devstack sudo[84061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:51 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.463s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:51 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:38:51 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-323e3b2f-0b57-4788-8bc6-11853d119407 tempest-GroupsV314Test-1464336664 None] Delete group completed successfully.
Apr 20 18:38:52 devstack sudo[84061]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605" returned: 0 in 0.539s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ab5b78-35ea-40ff-a009-d6b342f6a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f73205-f783-4afc-a09a-77d52ec49605', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ccab2c4-158e-4af6-9c3f-06bef561d800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:38:52 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Volume volume-05f73205-f783-4afc-a09a-77d52ec49605 (05f73205-f783-4afc-a09a-77d52ec49605): created successfully
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ccab2c4-158e-4af6-9c3f-06bef561d800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Flow 'volume_create_manager' (79885beb-ff21-4563-8543-97f48aac1bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:38:52 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-9e3a3e14-07aa-42df-ab26-3251e3f5aad8 tempest-SnapshotsActionsTest-593683348 None] Created volume successfully.
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Creating offline snapshot 81a81307-b057-4e08-b261-f8683e874318 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d983b994-5280-4d34-a2eb-12ae7bd082db]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:53 devstack sudo[84071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605
Apr 20 18:38:53 devstack sudo[84071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:53 devstack sudo[84071]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605" returned: 0 in 0.606s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:53 devstack sudo[84087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 1G
Apr 20 18:38:53 devstack sudo[84087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:54 devstack sudo[84087]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 1G" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:54 devstack sudo[84092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:38:54 devstack sudo[84092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:54 devstack sudo[84092]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:54 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 is being set with open permissions: ugo+rw
Apr 20 18:38:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:54 devstack sudo[84097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:38:54 devstack sudo[84097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:55 devstack sudo[84097]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:55 devstack sudo[84100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info
Apr 20 18:38:55 devstack sudo[84100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:55 devstack sudo[84100]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:55 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info is being set with open permissions: ugo+rw
Apr 20 18:38:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:55 devstack sudo[84106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info
Apr 20 18:38:55 devstack sudo[84106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:56 devstack sudo[84106]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.info" returned: 0 in 0.457s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.180s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.010s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-8c9b2c47-8dd5-4f22-8465-59ce7af3571f-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:56 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-98d95125-2776-4935-a33d-efb7d818459c tempest-SnapshotsActionsTest-593683348 None] Create snapshot completed successfully
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-8c9b2c47-8dd5-4f22-8465-59ce7af3571f-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Creating volume 04e597d8-dad7-4659-b4f7-8fb0256e7b6b from snapshot 8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] snapshot: 8c9b2c47-8dd5-4f22-8465-59ce7af3571f, volume: 04e597d8-dad7-4659-b4f7-8fb0256e7b6b,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[61794df3-86c4-4d91-8162-dcafc67cef09]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:56 devstack sudo[84109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f
Apr 20 18:38:56 devstack sudo[84109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:56 devstack sudo[84109]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f" returned: 0 in 0.546s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d11e877-7e79-4568-8129-a6a955941104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1692f6-93f5-4fff-a31b-40818897c42f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:38:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:56 devstack sudo[84114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:38:56 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:57 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root
Apr 20 18:38:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.846s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:38:57 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:38:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:38:57 devstack sudo[84147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b
Apr 20 18:38:57 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:38:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:00 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" returned: 0 in 3.197s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[548aa13f-5dbe-47a9-9c92-7e254f2cc013]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:00 devstack sudo[84162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:39:00 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Flow 'volume_create_manager' (3a165976-821d-4e3e-89a8-7b426331fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d74550-6a71-4e23-8b70-96debe254bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d74550-6a71-4e23-8b70-96debe254bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-501227430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d908bdc-4bac-4609-a776-83ec70a418fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01016c4128a43e0bfd50ca9e3577f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:01Z,use_quota=True,user_id='28f47369496f4205b3fc8701acb558c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f352249d-3dc2-446f-8ec0-b69c17b05753),volume_type_id=f352249d-3dc2-446f-8ec0-b69c17b05753)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c9fccd-da26-4883-a096-8dd6a8f56ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c9fccd-da26-4883-a096-8dd6a8f56ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c54e30-fcfd-419b-89d0-3fab10157137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c54e30-fcfd-419b-89d0-3fab10157137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d908bdc-4bac-4609-a776-83ec70a418fc', 'volume_name': 'volume-0d908bdc-4bac-4609-a776-83ec70a418fc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010afcc6-ce29-4fe8-baaa-74959bc386fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010afcc6-ce29-4fe8-baaa-74959bc386fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ced8fb-a29e-42c9-b873-9b4f0d587eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:01 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Volume 0d908bdc-4bac-4609-a776-83ec70a418fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d908bdc-4bac-4609-a776-83ec70a418fc', 'volume_size': 1}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:01 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.791s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104, size 1024.00 MB, duration 3.20 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:39:01 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Converted 1024.00 MB image at 320.20 MB/s
Apr 20 18:39:01 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:01 devstack sudo[84168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b
Apr 20 18:39:01 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:01 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" returned: 0 in 0.447s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" released by "_copy_volume_from_snapshot" :: held 5.890s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-8c9b2c47-8dd5-4f22-8465-59ce7af3571f-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" released by "_create_volume_from_snapshot" :: held 5.907s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.930s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.937s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Creating offline snapshot 39767f8c-0f27-432c-98cb-a489874e0477 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e2ab8d-f666-4f8f-911d-f482be8dca7c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-91112049-4800-4e09-9e15-2283eeaa9bbf tempest-GroupSnapshotsTest-895773677 None] Create group from source-snapshot-031a2295-677b-420a-a1e9-a2b06a908277 completed successfully.
Apr 20 18:39:02 devstack sudo[84172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:02 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:02 devstack sudo[84174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:02 devstack sudo[84174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5360ce8f-7047-4b9c-9ce3-ecdbb73de7a1]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:02 devstack sudo[84176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b
Apr 20 18:39:02 devstack sudo[84176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:02 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.670s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:02 devstack sudo[84182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 1G
Apr 20 18:39:02 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:02 devstack sudo[84174]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.593s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:03 devstack sudo[84176]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" returned: 0 in 0.606s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:03 devstack sudo[84188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b
Apr 20 18:39:03 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:03 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 1G" returned: 0 in 0.661s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:03 devstack sudo[84197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477
Apr 20 18:39:03 devstack sudo[84197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:03 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" returned: 0 in 0.565s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-04e597d8-dad7-4659-b4f7-8fb0256e7b6b" released by "delete_volume" :: held 1.200s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Created reservations ['e680b4b7-187a-4c75-bcd8-ea856ec10119'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:03 devstack cinder-volume[82268]: WARNING cinder.quota [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-572642471 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-572642471, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:03 devstack cinder-volume[82268]: WARNING cinder.quota [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-572642471 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-572642471, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Created reservations ['4d6e2060-19d8-4bd8-8f74-0c42d40ec0c7', 'b16fed50-5338-40cc-909a-e88fb7ac8b21', 'fb2706ed-6337-406b-9de9-3ce37b82079f', '3917c287-af08-49ae-bf4e-eaa7dae221b1'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:03 devstack sudo[84206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:03 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:03 devstack sudo[84197]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477" returned: 0 in 0.524s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:03 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 is being set with open permissions: ugo+rw
Apr 20 18:39:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:03 devstack sudo[84208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477
Apr 20 18:39:03 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:04 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.459s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:04 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5fcb860a-b7ec-451f-b6bd-39b2186f9b6d tempest-GroupSnapshotsTest-895773677 None] Delete group completed successfully.
Apr 20 18:39:04 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477" returned: 0 in 0.447s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.115s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-501227430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d908bdc-4bac-4609-a776-83ec70a418fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01016c4128a43e0bfd50ca9e3577f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:01Z,use_quota=True,user_id='28f47369496f4205b3fc8701acb558c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f352249d-3dc2-446f-8ec0-b69c17b05753),volume_type_id=f352249d-3dc2-446f-8ec0-b69c17b05753)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Creating volume 0d908bdc-4bac-4609-a776-83ec70a418fc {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:04 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:04 devstack sudo[84212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc 1073741824
Apr 20 18:39:04 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:04 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a2329c96-d8e4-4961-8493-4adbd76c3100 tempest-SnapshotsActionsTest-593683348 None] Create snapshot completed successfully
Apr 20 18:39:04 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] group_snapshot 031a2295-677b-420a-a1e9-a2b06a908277: deleting
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] group_snapshot 031a2295-677b-420a-a1e9-a2b06a908277: deleting {{(pid=82268) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-9d11e877-7e79-4568-8129-a6a955941104" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-9d11e877-7e79-4568-8129-a6a955941104" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-8c9b2c47-8dd5-4f22-8465-59ce7af3571f" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-8c9b2c47-8dd5-4f22-8465-59ce7af3571f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Deleting offline snapshot 8c9b2c47-8dd5-4f22-8465-59ce7af3571f of volume 9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] snapshot_file for this snap is: volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b20800c-2c0b-47ca-8e39-246e261a82aa]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:04 devstack sudo[84221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f
Apr 20 18:39:04 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:04 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc 1073741824" returned: 0 in 0.580s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:05 devstack sudo[84226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc
Apr 20 18:39:05 devstack sudo[84226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:05 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f" returned: 0 in 0.591s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d11e877-7e79-4568-8129-a6a955941104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8562285-4f8b-496d-a671-8a3c7acaa707]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:05 devstack sudo[84226]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc" returned: 0 in 0.485s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ced8fb-a29e-42c9-b873-9b4f0d587eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d908bdc-4bac-4609-a776-83ec70a418fc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e429f73-c314-4f39-a5f4-5099f52bc73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Volume volume-0d908bdc-4bac-4609-a776-83ec70a418fc (0d908bdc-4bac-4609-a776-83ec70a418fc): created successfully
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e429f73-c314-4f39-a5f4-5099f52bc73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Flow 'volume_create_manager' (3a165976-821d-4e3e-89a8-7b426331fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:05 devstack sudo[84253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:39:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-17deae29-278c-41df-bfbe-4a3f7f0ed3f1 tempest-VolumeTypesAccessTest-845089599 None] Created volume successfully.
Apr 20 18:39:05 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-39767f8c-0f27-432c-98cb-a489874e0477-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-39767f8c-0f27-432c-98cb-a489874e0477-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-39767f8c-0f27-432c-98cb-a489874e0477" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-39767f8c-0f27-432c-98cb-a489874e0477" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Deleting offline snapshot 39767f8c-0f27-432c-98cb-a489874e0477 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] snapshot_file for this snap is: volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a04ab93-8a25-4710-bd8e-a15605f40ac7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:05 devstack sudo[84255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477
Apr 20 18:39:05 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:05 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.544s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:05 devstack sudo[84260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f
Apr 20 18:39:05 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:06 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477" returned: 0 in 0.519s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd585ae-7e18-4d0d-8f97-2857ba379b40]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:06 devstack sudo[84265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:06 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:06 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f" returned: 0 in 0.514s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:06 devstack sudo[84270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f
Apr 20 18:39:06 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Acquiring lock "cinder-0d908bdc-4bac-4609-a776-83ec70a418fc-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Lock "cinder-0d908bdc-4bac-4609-a776-83ec70a418fc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Acquiring lock "cinder-quobyte-0d908bdc-4bac-4609-a776-83ec70a418fc" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Lock "cinder-quobyte-0d908bdc-4bac-4609-a776-83ec70a418fc" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8dc4f5-49fc-4f5c-a327-f5feb0843d33]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:06 devstack sudo[84272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc
Apr 20 18:39:06 devstack sudo[84272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:07 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.849s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:07 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104.8c9b2c47-8dd5-4f22-8465-59ce7af3571f" returned: 0 in 0.556s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:07 devstack sudo[84278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477
Apr 20 18:39:07 devstack sudo[84278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-8c9b2c47-8dd5-4f22-8465-59ce7af3571f" released by "_delete_snapshot" :: held 2.288s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-9d11e877-7e79-4568-8129-a6a955941104" released by "delete_snapshot" :: held 2.304s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:07 devstack cinder-volume[82268]: WARNING cinder.quota [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-572642471 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-572642471, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] Created reservations ['2e4a5b2b-8c04-47fc-9f28-00a1dec78137', '86eb9953-3eaf-4d2c-a7a0-8c2cb67150bd', '0579e6c9-3d2b-416a-8175-01f44f3c2e07', '598e9890-af88-4380-b89b-d378676fc699'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:07 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-9e1332d1-52b0-4276-a131-7ba3efe5566b tempest-GroupSnapshotsTest-895773677 None] group_snapshot 031a2295-677b-420a-a1e9-a2b06a908277: deleted successfully
Apr 20 18:39:07 devstack sudo[84272]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc" returned: 0 in 0.661s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:07 devstack sudo[84283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc
Apr 20 18:39:07 devstack sudo[84283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:07 devstack sudo[84278]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477" returned: 0 in 0.601s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:07 devstack sudo[84288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477
Apr 20 18:39:07 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:07 devstack sudo[84283]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d908bdc-4bac-4609-a776-83ec70a418fc" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Lock "cinder-quobyte-0d908bdc-4bac-4609-a776-83ec70a418fc" released by "delete_volume" :: held 1.155s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:07 devstack cinder-volume[82268]: WARNING cinder.quota [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-260958102 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-260958102, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:07 devstack cinder-volume[82268]: WARNING cinder.quota [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-260958102 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-260958102, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Created reservations ['a70bb42d-7f09-4677-9b34-791f10612f1c', '475362e9-bff3-49cb-9dc7-e23413a1e75b', '6109182c-681c-4f66-8fba-c6d08fb2917c', '19b722b3-bdb8-45eb-a2fb-222cd9340d2b'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:07 devstack sudo[84291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:07 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:08 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.39767f8c-0f27-432c-98cb-a489874e0477" returned: 0 in 0.594s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-9d11e877-7e79-4568-8129-a6a955941104" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-39767f8c-0f27-432c-98cb-a489874e0477" released by "_delete_snapshot" :: held 2.632s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" released by "delete_snapshot" :: held 2.646s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-9d11e877-7e79-4568-8129-a6a955941104" acquired by "delete_volume" :: waited 0.027s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6894bc18-f54f-42c9-bc68-bf8788e25ae3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Created reservations ['91f3cbff-0593-48c5-b320-7e07d6534b12', '2881c7bf-8e2f-46dd-92bb-6b7816534c20', 'd29c0d41-7e38-4797-8fdc-c252a95d4d43', '1721aeee-803a-44e7-9cd2-414c0712c83c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Delete snapshot completed successfully.
Apr 20 18:39:08 devstack sudo[84294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-79759e23-48c1-4566-8043-1ddb683e2fa0 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-39767f8c-0f27-432c-98cb-a489874e0477-delete_snapshot" released by "delete_snapshot" :: held 2.808s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:08 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:08 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.572s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Deleted volume successfully.
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fc8e818b-fc0d-45d2-a440-c3092f9df5cc tempest-VolumeTypesAccessTest-845089599 None] Lock "cinder-0d908bdc-4bac-4609-a776-83ec70a418fc-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:08 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.664s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:08 devstack sudo[84309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104
Apr 20 18:39:08 devstack sudo[84309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Creating offline snapshot 19c41e07-2199-4032-8427-a06dfa381110 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d43d6b-f7ab-496a-ac33-1832e5d5fc70]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:09 devstack sudo[84312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:09 devstack sudo[84312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:09 devstack sudo[84309]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9d11e877-7e79-4568-8129-a6a955941104" returned: 0 in 0.687s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-9d11e877-7e79-4568-8129-a6a955941104" released by "delete_volume" :: held 1.378s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Created reservations ['a4a798d0-3fd1-40c7-86f6-a53363da1122'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:09 devstack cinder-volume[82268]: WARNING cinder.db.sqlalchemy.api [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-572642471']
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Created reservations ['7101f12b-c53f-41ea-958a-e9b64aaf31c6', '47dea278-5a36-4432-a171-3caa1b658791', '66f967b1-1b0b-4d2f-9059-aeb112780b2d', '96b13247-71b3-46db-945b-817e88f40178'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:09 devstack sudo[84321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:09 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:09 devstack sudo[84312]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.672s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:09 devstack sudo[84323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 1G
Apr 20 18:39:09 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:10 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.488s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:10 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e10cb778-588f-4e3f-b0a3-20c6ab4d999a tempest-GroupSnapshotsTest-895773677 None] Delete group completed successfully.
Apr 20 18:39:10 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 1G" returned: 0 in 0.668s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:10 devstack sudo[84331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110
Apr 20 18:39:10 devstack sudo[84331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8d0f8edd-fb0c-41b5-bd82-8249319e7dee tempest-GroupSnapshotsTest-895773677 None] Group tempest-GroupSnapshotsTest-Group-840537854: creating
Apr 20 18:39:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8d0f8edd-fb0c-41b5-bd82-8249319e7dee tempest-GroupSnapshotsTest-895773677 None] Group tempest-GroupSnapshotsTest-Group-840537854: created successfully
Apr 20 18:39:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8d0f8edd-fb0c-41b5-bd82-8249319e7dee tempest-GroupSnapshotsTest-895773677 None] Create group completed successfully.
Apr 20 18:39:11 devstack sudo[84331]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110" returned: 0 in 0.557s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:11 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 is being set with open permissions: ugo+rw
Apr 20 18:39:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:11 devstack sudo[84336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110
Apr 20 18:39:11 devstack sudo[84336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:11 devstack sudo[84336]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110" returned: 0 in 0.453s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f1477886-6d28-46a4-ae3b-8c2b3fdca19e tempest-SnapshotsActionsTest-593683348 None] Create snapshot completed successfully
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (17234e7e-9d47-4d7d-b3c2-22def46bb549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba94dbc-39c8-4907-a3df-fe5088993e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba94dbc-39c8-4907-a3df-fe5088993e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-769326543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=02833b4b-232d-4170-81aa-c8a614bfd695,host='devstack@QuobyteHD#QuobyteHD',id=b597a034-eb99-4cf9-979b-b938c7d0ce21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:12Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba11e62b-0477-4fbe-886c-1f4b24d4e71e),volume_type_id=ba11e62b-0477-4fbe-886c-1f4b24d4e71e)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005928f4-473b-4e9a-9ef7-24673c5b5305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005928f4-473b-4e9a-9ef7-24673c5b5305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8590bd01-7844-4499-921c-04ccb0e7ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8590bd01-7844-4499-921c-04ccb0e7ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b597a034-eb99-4cf9-979b-b938c7d0ce21', 'volume_name': 'volume-b597a034-eb99-4cf9-979b-b938c7d0ce21', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7e90f3-2951-44a4-a8f3-a4148edf6170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7e90f3-2951-44a4-a8f3-a4148edf6170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f67f56-f93c-4b59-ac3a-c459d4b102f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:12 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Volume b597a034-eb99-4cf9-979b-b938c7d0ce21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b597a034-eb99-4cf9-979b-b938c7d0ce21', 'volume_size': 1}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=02833b4b-232d-4170-81aa-c8a614bfd695,created_at=2026-04-20T16:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-769326543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=02833b4b-232d-4170-81aa-c8a614bfd695,host='devstack@QuobyteHD#QuobyteHD',id=b597a034-eb99-4cf9-979b-b938c7d0ce21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:12Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba11e62b-0477-4fbe-886c-1f4b24d4e71e),volume_type_id=ba11e62b-0477-4fbe-886c-1f4b24d4e71e)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Creating volume b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:12 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:12 devstack sudo[84339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 1073741824
Apr 20 18:39:12 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-19c41e07-2199-4032-8427-a06dfa381110-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-19c41e07-2199-4032-8427-a06dfa381110-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-19c41e07-2199-4032-8427-a06dfa381110" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-19c41e07-2199-4032-8427-a06dfa381110" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Deleting offline snapshot 19c41e07-2199-4032-8427-a06dfa381110 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] snapshot_file for this snap is: volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97fd01b-fe3f-4ecd-89cd-4a3f1145e2d6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:12 devstack sudo[84341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110
Apr 20 18:39:12 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:12 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 1073741824" returned: 0 in 0.692s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:12 devstack sudo[84346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21
Apr 20 18:39:12 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:13 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110" returned: 0 in 0.625s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bea670-9cc5-4eb9-bbfe-f3b18e396d0d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:13 devstack sudo[84351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:13 devstack sudo[84351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:13 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21" returned: 0 in 0.691s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f67f56-f93c-4b59-ac3a-c459d4b102f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b597a034-eb99-4cf9-979b-b938c7d0ce21', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d2906c-7103-41e9-81aa-13180e46a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:13 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Volume volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 (b597a034-eb99-4cf9-979b-b938c7d0ce21): created successfully
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d2906c-7103-41e9-81aa-13180e46a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (17234e7e-9d47-4d7d-b3c2-22def46bb549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c560cc8d-a452-4092-9b4f-a6cd97716500 tempest-GroupSnapshotsTest-895773677 None] Created volume successfully.
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Flow 'volume_create_manager' (7ebb4268-4ec7-4372-ac8d-51e832aba5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8491004c-253d-4c2e-b40c-09b6e3f85509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8491004c-253d-4c2e-b40c-09b6e3f85509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-19891764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0fcbba-c7da-4fe1-99ae-cc8803237261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5b720226944c29132c3cf1a384ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:14Z,use_quota=True,user_id='aa90ea12ad2f4eaba85b8fb33833dbe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68628b25-b9ea-47ff-a27c-bdcbc8db4953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68628b25-b9ea-47ff-a27c-bdcbc8db4953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd758dcb-995c-41bf-b894-ca3b688e955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.image.glance [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Creating Keystone auth plugin from conf {{(pid=82268) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 18:39:13 devstack sudo[84351]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.806s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:13 devstack sudo[84358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110
Apr 20 18:39:13 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd758dcb-995c-41bf-b894-ca3b688e955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa0fcbba-c7da-4fe1-99ae-cc8803237261', 'volume_name': 'volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0c930d0>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0db7d90-0820-4e2c-814b-d64eaa414a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0db7d90-0820-4e2c-814b-d64eaa414a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2532e651-99ec-4d59-844b-04f79b987a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:14 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Volume aa0fcbba-c7da-4fe1-99ae-cc8803237261: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0c930d0>}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Trying to clone aa0fcbba-c7da-4fe1-99ae-cc8803237261 from image 176162cd-bd53-4e34-b5ee-78401d9b8736 at location (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]). {{(pid=82268) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 18:39:14 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e06804a-7add-4cce-aa4e-169c51811305]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:14 devstack sudo[84384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD
Apr 20 18:39:14 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:14 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110" returned: 0 in 0.820s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:14 devstack sudo[84386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110
Apr 20 18:39:14 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (f3ae6f00-62f1-4ea0-bd91-d9a6bac1bd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27b0b71-5fae-4a5f-a35b-8086e4460850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27b0b71-5fae-4a5f-a35b-8086e4460850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1097929856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=02833b4b-232d-4170-81aa-c8a614bfd695,host='devstack@QuobyteHD#QuobyteHD',id=81d89f0f-f3e4-414a-b781-bb4ccecbda09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:15Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba11e62b-0477-4fbe-886c-1f4b24d4e71e),volume_type_id=ba11e62b-0477-4fbe-886c-1f4b24d4e71e)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e229f729-9e02-475d-b70c-176552ea4b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e229f729-9e02-475d-b70c-176552ea4b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775b2892-7055-47d8-b7ef-1f7816f99800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775b2892-7055-47d8-b7ef-1f7816f99800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d89f0f-f3e4-414a-b781-bb4ccecbda09', 'volume_name': 'volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc9baa-3868-4001-95e8-5836c88cb77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39bc9baa-3868-4001-95e8-5836c88cb77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0e1e3d-0735-4789-b4fe-19735c2cb472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Volume 81d89f0f-f3e4-414a-b781-bb4ccecbda09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09', 'volume_size': 1}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=02833b4b-232d-4170-81aa-c8a614bfd695,created_at=2026-04-20T16:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1097929856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=02833b4b-232d-4170-81aa-c8a614bfd695,host='devstack@QuobyteHD#QuobyteHD',id=81d89f0f-f3e4-414a-b781-bb4ccecbda09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:15Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba11e62b-0477-4fbe-886c-1f4b24d4e71e),volume_type_id=ba11e62b-0477-4fbe-886c-1f4b24d4e71e)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Creating volume 81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:15 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:15 devstack sudo[84390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 1073741824
Apr 20 18:39:15 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Flow 'volume_create_manager' (9afd3f39-0bc6-45fe-91e7-be61c3fcb317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bd189f-2614-4ffb-898c-d5041f9977b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bd189f-2614-4ffb-898c-d5041f9977b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:15Z,deleted=False,deleted_at=None,display_description='',display_name='e5f74aba-313e-4e0b-9c85-4777e21cb6cd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dba65af-9fa8-43dc-8e03-c1fb2d045175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273d465957d645ff964b5b2f98acad5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:15Z,use_quota=True,user_id='693a289eb5484fea840aa50ffffc047c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346707e4-edb8-4680-b9d1-1aa0281f0e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346707e4-edb8-4680-b9d1-1aa0281f0e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577bedde-c406-44f7-ba6c-f260bd66cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577bedde-c406-44f7-ba6c-f260bd66cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dba65af-9fa8-43dc-8e03-c1fb2d045175', 'volume_name': 'volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea972c09-f270-43fe-ae60-30e84a39a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea972c09-f270-43fe-ae60-30e84a39a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ac1fc7-5456-4b88-857a-0399c342f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:15 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Volume 7dba65af-9fa8-43dc-8e03-c1fb2d045175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175', 'volume_size': 1}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:15 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD" returned: 0 in 0.996s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 is fetched for user aa90ea12ad2f4eaba85b8fb33833dbe2. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 18:39:15 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.19c41e07-2199-4032-8427-a06dfa381110" returned: 0 in 0.836s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-19c41e07-2199-4032-8427-a06dfa381110" released by "_delete_snapshot" :: held 3.162s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" released by "delete_snapshot" :: held 3.180s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6163f1-44ad-4763-925c-d5f5b58afd6a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Created reservations ['f3b46536-b427-4bae-a8f2-8d8bcee6582c', 'b289324a-6c10-4669-ada7-24aef3a868a9', '4475ea43-6795-4ca8-84e5-576019700c5c', '8c27942d-a585-44cb-a4df-a63a6736ed82'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:15 devstack sudo[84396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD
Apr 20 18:39:15 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:15 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Delete snapshot completed successfully.
Apr 20 18:39:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6b457b9f-8a43-4920-aa94-bfd6cf6be831 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-19c41e07-2199-4032-8427-a06dfa381110-delete_snapshot" released by "delete_snapshot" :: held 3.348s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:16 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 1073741824" returned: 0 in 0.786s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:16 devstack sudo[84435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09
Apr 20 18:39:16 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:16 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:16 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:15Z,deleted=False,deleted_at=None,display_description='',display_name='e5f74aba-313e-4e0b-9c85-4777e21cb6cd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dba65af-9fa8-43dc-8e03-c1fb2d045175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273d465957d645ff964b5b2f98acad5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:15Z,use_quota=True,user_id='693a289eb5484fea840aa50ffffc047c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Creating volume 7dba65af-9fa8-43dc-8e03-c1fb2d045175 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:16 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0e1e3d-0735-4789-b4fe-19735c2cb472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fc252b-db6e-4104-a99d-5a6071c24df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:16 devstack sudo[84441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 1073741824
Apr 20 18:39:16 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:16 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Volume volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 (81d89f0f-f3e4-414a-b781-bb4ccecbda09): created successfully
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fc252b-db6e-4104-a99d-5a6071c24df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (f3ae6f00-62f1-4ea0-bd91-d9a6bac1bd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b2453c05-9075-449d-811c-a339155ea56b tempest-GroupSnapshotsTest-895773677 None] Created volume successfully.
Apr 20 18:39:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:17 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 1073741824" returned: 0 in 0.600s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:17 devstack sudo[84446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175
Apr 20 18:39:17 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:17 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-79ba10e0-8fc6-409c-8275-383067242db1 tempest-GroupSnapshotsTest-895773677 None] Update group completed successfully.
Apr 20 18:39:17 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175" returned: 0 in 0.480s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-19891764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0fcbba-c7da-4fe1-99ae-cc8803237261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e5b720226944c29132c3cf1a384ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:14Z,use_quota=True,user_id='aa90ea12ad2f4eaba85b8fb33833dbe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Creating volume aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:17 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ac1fc7-5456-4b88-857a-0399c342f614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:17 devstack sudo[84450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 1073741824
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1caa32e1-0896-46f7-b4ed-c4aedaded663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:17 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:17 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Volume volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 (7dba65af-9fa8-43dc-8e03-c1fb2d045175): created successfully
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1caa32e1-0896-46f7-b4ed-c4aedaded663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Flow 'volume_create_manager' (9afd3f39-0bc6-45fe-91e7-be61c3fcb317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:17 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-cfb5ec57-448d-4f49-ad33-672fe128fd66 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Created volume successfully.
Apr 20 18:39:18 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 1073741824" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:18 devstack sudo[84456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:18 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:18 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ec5f00f4-f56d-4cea-aee4-652e04a4062f tempest-GroupSnapshotsTest-895773677 None] Update group completed successfully.
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:18 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.837s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Attempting download of 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume aa0fcbba-c7da-4fe1-99ae-cc8803237261. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Creating offline snapshot 9b4c4437-0990-40af-b2cc-719123040a43 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[60679869-bc9e-4ad0-9d54-1c003a9ec6cf]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de70e40-46a6-447c-bd9c-f3a05587d826]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:18 devstack sudo[84471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:18 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:18 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3
Apr 20 18:39:18 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:19 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3" returned: 0 in 0.483s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:19 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.514s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:19 devstack sudo[84490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 1G
Apr 20 18:39:19 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:19 devstack sudo[84489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3
Apr 20 18:39:19 devstack sudo[84489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:19 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a9c9b4fc-3125-4c1c-b55c-fc873f27ccf3 tempest-GroupSnapshotsTest-895773677 None] Update group completed successfully.
Apr 20 18:39:19 devstack sudo[84489]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3" returned: 1 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_2mhnt9t3' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c6979-0614-46b0-9148-9dd121ba6bec]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:19 devstack sudo[84498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD
Apr 20 18:39:19 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:19 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 1G" returned: 0 in 0.539s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:19 devstack sudo[84500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43
Apr 20 18:39:19 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:20 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] 176162cd-bd53-4e34-b5ee-78401d9b8736 was qcow2, converting to raw {{(pid=82268) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:20 devstack sudo[84506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:20 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:20 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:20 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 is being set with open permissions: ugo+rw
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:20 devstack sudo[84510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43
Apr 20 18:39:20 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:20 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6e9093ce-ee0b-431b-be8c-f240fb339e3a tempest-GroupSnapshotsTest-895773677 None] Update group completed successfully.
Apr 20 18:39:20 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.140s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[882ca141-ebf1-4b1e-bf04-f4ed50544b9c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:20 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-629f4905-d4cf-4f1b-a00d-a0f67f3303f4 tempest-SnapshotsActionsTest-593683348 None] Create snapshot completed successfully
Apr 20 18:39:20 devstack sudo[84528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175
Apr 20 18:39:20 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:21 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 0 in 0.879s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_s2jhsc6tdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:39:21 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-9b4c4437-0990-40af-b2cc-719123040a43-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-9b4c4437-0990-40af-b2cc-719123040a43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:21 devstack sudo[84530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 1G
Apr 20 18:39:21 devstack sudo[84530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-9b4c4437-0990-40af-b2cc-719123040a43" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-9b4c4437-0990-40af-b2cc-719123040a43" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Deleting offline snapshot 9b4c4437-0990-40af-b2cc-719123040a43 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] snapshot_file for this snap is: volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[092e79ae-d948-4b1d-94c5-d2eaaa3f43ca]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:21 devstack sudo[84532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43
Apr 20 18:39:21 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:21 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175" returned: 0 in 0.629s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.643s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba', 'name': 'volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99675bcc-8bc3-47bd-9d54-72564d113ace', 'enforce_multipath': True} {{(pid=82268) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 18:39:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-afc597a5-2028-48e9-8054-5ad481265c0a req-ccc6ed0a-1bc3-40bc-b618-74ea50ac1bdf tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] attachment_update completed successfully.
Apr 20 18:39:21 devstack sudo[84530]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 1G" returned: 0 in 0.600s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc414af-8ea9-4644-80a7-f38110f43b49]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:21 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43" returned: 0 in 0.564s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f1c0bb-96e0-4611-91ae-383ecefaa3ca]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:21 devstack sudo[84543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:21 devstack sudo[84543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:21 devstack sudo[84544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:21 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] GroupSnapshot aa7ae1a5-c28f-4194-9004-d8a90f035518: creating.
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Group snapshot aa7ae1a5-c28f-4194-9004-d8a90f035518: creating. {{(pid=82268) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Creating offline snapshot 1367670f-a3c6-4349-a07e-cac43d8a4bba of volume b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea86ff4-94b2-4085-86a8-d8ed40cc5653]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:21 devstack sudo[84547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21
Apr 20 18:39:21 devstack sudo[84547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:22 devstack sudo[84543]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 0 in 0.534s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:22 devstack sudo[84551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:22 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:22 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.693s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:22 devstack sudo[84559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43
Apr 20 18:39:22 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:22 devstack sudo[84547]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:22 devstack sudo[84561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba 1G
Apr 20 18:39:22 devstack sudo[84561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:22 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 1 in 0.704s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Downloaded image 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume aa0fcbba-c7da-4fe1-99ae-cc8803237261 successfully. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 for user aa90ea12ad2f4eaba85b8fb33833dbe2 is deleted. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Marking volume aa0fcbba-c7da-4fe1-99ae-cc8803237261 as bootable. {{(pid=82268) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Copying metadata from image 176162cd-bd53-4e34-b5ee-78401d9b8736 to aa0fcbba-c7da-4fe1-99ae-cc8803237261. {{(pid=82268) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Creating volume glance metadata for volume aa0fcbba-c7da-4fe1-99ae-cc8803237261 backed by image 176162cd-bd53-4e34-b5ee-78401d9b8736 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82268) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2532e651-99ec-4d59-844b-04f79b987a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0c930d0>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24cbf0a-43cc-4fd0-aa57-f8b5bd71d5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:22 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Volume volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 (aa0fcbba-c7da-4fe1-99ae-cc8803237261): created successfully
Apr 20 18:39:22 devstack sudo[84561]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c24cbf0a-43cc-4fd0-aa57-f8b5bd71d5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Flow 'volume_create_manager' (7ebb4268-4ec7-4372-ac8d-51e832aba5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43" returned: 0 in 0.610s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba 1G" returned: 0 in 0.577s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:23 devstack sudo[84572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43
Apr 20 18:39:23 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:23 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e868a9cc-4828-4562-9b78-a625f953118e tempest-VolumesImageMetadata-1301021618 None] Created volume successfully.
Apr 20 18:39:23 devstack sudo[84573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba
Apr 20 18:39:23 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:23 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.9b4c4437-0990-40af-b2cc-719123040a43" returned: 0 in 0.503s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-9b4c4437-0990-40af-b2cc-719123040a43" released by "_delete_snapshot" :: held 2.437s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" released by "delete_snapshot" :: held 2.458s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:23 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba" returned: 0 in 0.522s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:23 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:23 devstack sudo[84647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba
Apr 20 18:39:23 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Created reservations ['ada55b19-af92-45dd-8d7f-25504dfe8742', 'e859818a-2361-4f0f-ade9-d455a8333548', 'ff673cb0-fe03-40b9-95e7-d61f67d16297', 'ae492b8c-d38f-4f7d-ba37-70c0efa53fa1'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:23 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Delete snapshot completed successfully.
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b4090a7f-968b-42cb-b6b4-9db1d2b84f2b tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-9b4c4437-0990-40af-b2cc-719123040a43-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Acquiring lock "cinder-aa0fcbba-c7da-4fe1-99ae-cc8803237261-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Lock "cinder-aa0fcbba-c7da-4fe1-99ae-cc8803237261-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Acquiring lock "cinder-quobyte-aa0fcbba-c7da-4fe1-99ae-cc8803237261" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Lock "cinder-quobyte-aa0fcbba-c7da-4fe1-99ae-cc8803237261" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[885adbdc-ce6c-4fca-8c74-7321446e620a]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:23 devstack sudo[84649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:23 devstack sudo[84649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:24 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba" returned: 0 in 0.573s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:24 devstack sudo[84652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info
Apr 20 18:39:24 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:24 devstack sudo[84649]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 0 in 0.540s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:24 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:24 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:24 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info" returned: 0 in 0.546s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:24 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:24 devstack sudo[84662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info
Apr 20 18:39:24 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:24 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 1 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:39:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:25 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261
Apr 20 18:39:25 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:25 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.info" returned: 0 in 0.428s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.219s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Creating offline snapshot dd4ae7e7-b4ac-4193-a03a-04402409fc6a of volume 81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad48822-a36d-4600-9bd5-44243386ea8a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:25 devstack sudo[84670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09
Apr 20 18:39:25 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:25 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aa0fcbba-c7da-4fe1-99ae-cc8803237261" returned: 0 in 0.484s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Lock "cinder-quobyte-aa0fcbba-c7da-4fe1-99ae-cc8803237261" released by "delete_volume" :: held 1.609s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Created reservations ['f20b625c-7807-435c-bc3d-6bb78c64dd82', 'e4a7de70-3ca9-4787-90e4-93e638798a54', '6d9a4bb9-563c-4b0e-adba-3670a7e261d2', '889e076f-6f02-45a0-a441-6ae191c2843d'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:25 devstack sudo[84675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:25 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:25 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09" returned: 0 in 0.498s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:25 devstack sudo[84678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a 1G
Apr 20 18:39:25 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:25 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.421s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Deleted volume successfully.
Apr 20 18:39:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-af9eb26b-7570-4ca4-96cd-453c75b9bce0 tempest-VolumesImageMetadata-1301021618 None] Lock "cinder-aa0fcbba-c7da-4fe1-99ae-cc8803237261-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:26 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a 1G" returned: 0 in 0.684s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:26 devstack sudo[85019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a
Apr 20 18:39:26 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:27 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a" returned: 0 in 0.728s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:27 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:27 devstack sudo[85028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a
Apr 20 18:39:27 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:27 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a" returned: 0 in 0.495s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:27 devstack sudo[85032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info
Apr 20 18:39:27 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:28 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info" returned: 0 in 0.527s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:28 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:28 devstack sudo[85035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info
Apr 20 18:39:28 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:28 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.info" returned: 0 in 0.519s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.524s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.253s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Creating offline snapshot 453b3be3-8095-4012-aeb8-c290723fd755 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8615d611-920e-4c00-9e17-9d0c4b3cc346]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ee4cea86-4e7a-4dda-9aaf-0389943c20c3 tempest-GroupSnapshotsTest-895773677 None] group_snapshot aa7ae1a5-c28f-4194-9004-d8a90f035518: created successfully
Apr 20 18:39:28 devstack sudo[85039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:28 devstack sudo[85039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:29 devstack sudo[85039]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.602s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:29 devstack sudo[85044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 1G
Apr 20 18:39:29 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] group_snapshot aa7ae1a5-c28f-4194-9004-d8a90f035518: deleting
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] group_snapshot aa7ae1a5-c28f-4194-9004-d8a90f035518: deleting {{(pid=82268) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-b597a034-eb99-4cf9-979b-b938c7d0ce21" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-b597a034-eb99-4cf9-979b-b938c7d0ce21" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-1367670f-a3c6-4349-a07e-cac43d8a4bba" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-1367670f-a3c6-4349-a07e-cac43d8a4bba" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Deleting offline snapshot 1367670f-a3c6-4349-a07e-cac43d8a4bba of volume b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] snapshot_file for this snap is: volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aeee93-c9b5-4270-bfde-b595c6fef753]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:29 devstack sudo[85046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba
Apr 20 18:39:29 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:29 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 1G" returned: 0 in 0.614s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:29 devstack sudo[85051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755
Apr 20 18:39:29 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:30 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba" returned: 0 in 0.630s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b597a034-eb99-4cf9-979b-b938c7d0ce21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[50410396-1146-445a-bc37-735f3dba1bd5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:30 devstack sudo[85057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21
Apr 20 18:39:30 devstack sudo[85057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:30 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755" returned: 0 in 0.543s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:30 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 is being set with open permissions: ugo+rw
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:30 devstack sudo[85062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755
Apr 20 18:39:30 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:30 devstack sudo[85057]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21" returned: 0 in 0.562s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:30 devstack sudo[85068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba
Apr 20 18:39:30 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:30 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.319s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:30 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4f923771-d0b1-4006-a6f5-6cd594cf998d tempest-SnapshotsActionsTest-593683348 None] Create snapshot completed successfully
Apr 20 18:39:31 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba" returned: 0 in 0.554s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:31 devstack sudo[85074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba
Apr 20 18:39:31 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Flow 'volume_create_manager' (d33b1399-7970-4087-9116-8301243d1cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e074aba-434e-4dbf-a694-9bf3fd46f210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e074aba-434e-4dbf-a694-9bf3fd46f210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-70923993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a4b70c88d8454692cb7fe0c0961994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:31Z,use_quota=True,user_id='dbc17b6fa0f746fe8ead188e969a5db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc0e0a7-9850-455d-813f-936196316fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc0e0a7-9850-455d-813f-936196316fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b17549-e43a-4487-adf2-348c1b43298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b17549-e43a-4487-adf2-348c1b43298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2', 'volume_name': 'volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64956774-ff15-49ea-b704-9220157c525a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64956774-ff15-49ea-b704-9220157c525a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dc692c-52d3-415c-b61f-064191407b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Volume 5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2', 'volume_size': 1}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-70923993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a4b70c88d8454692cb7fe0c0961994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:31Z,use_quota=True,user_id='dbc17b6fa0f746fe8ead188e969a5db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Creating volume 5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:31 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:31 devstack sudo[85076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 1073741824
Apr 20 18:39:31 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:31 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21.1367670f-a3c6-4349-a07e-cac43d8a4bba" returned: 0 in 0.515s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-1367670f-a3c6-4349-a07e-cac43d8a4bba" released by "_delete_snapshot" :: held 2.314s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-b597a034-eb99-4cf9-979b-b938c7d0ce21" released by "delete_snapshot" :: held 2.326s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-453b3be3-8095-4012-aeb8-c290723fd755-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-81d89f0f-f3e4-414a-b781-bb4ccecbda09" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-453b3be3-8095-4012-aeb8-c290723fd755-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-81d89f0f-f3e4-414a-b781-bb4ccecbda09" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-dd4ae7e7-b4ac-4193-a03a-04402409fc6a" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Acquiring lock "cinder-quobyte-453b3be3-8095-4012-aeb8-c290723fd755" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-dd4ae7e7-b4ac-4193-a03a-04402409fc6a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Deleting offline snapshot dd4ae7e7-b4ac-4193-a03a-04402409fc6a of volume 81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] snapshot_file for this snap is: volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f2fea-4faf-438a-98d6-5b489d184b32]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-453b3be3-8095-4012-aeb8-c290723fd755" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Deleting offline snapshot 453b3be3-8095-4012-aeb8-c290723fd755 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] snapshot_file for this snap is: volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc276a-9865-42eb-9cb5-a05e75c3621d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:31 devstack sudo[85082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a
Apr 20 18:39:31 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:31 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:31 devstack sudo[85083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 1073741824" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:31 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:31 devstack sudo[85086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2
Apr 20 18:39:31 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:32 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a" returned: 0 in 0.504s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bcc6f1-b074-4f34-b543-cfee11dad881]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:32 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba8059-1bef-4e40-9510-f1e3ddc978b1]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:32 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2" returned: 0 in 0.450s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20dc692c-52d3-415c-b61f-064191407b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859c09cc-1c84-45b8-b3a4-7c49fe2f6ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:32 devstack sudo[85095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09
Apr 20 18:39:32 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:32 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Volume volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 (5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2): created successfully
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859c09cc-1c84-45b8-b3a4-7c49fe2f6ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Flow 'volume_create_manager' (d33b1399-7970-4087-9116-8301243d1cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4fae3632-2951-40ef-ae23-9f899df2243f tempest-VolumesTransfersV355Test-2009411738 None] Created volume successfully.
Apr 20 18:39:32 devstack sudo[85096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:32 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:32 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:32 devstack sudo[85105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a
Apr 20 18:39:32 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:32 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.538s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:32 devstack sudo[85107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755
Apr 20 18:39:32 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:33 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a" returned: 0 in 0.454s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:33 devstack sudo[85115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a
Apr 20 18:39:33 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:33 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755" returned: 0 in 0.557s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:33 devstack sudo[85123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755
Apr 20 18:39:33 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:33 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09.dd4ae7e7-b4ac-4193-a03a-04402409fc6a" returned: 0 in 0.517s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-dd4ae7e7-b4ac-4193-a03a-04402409fc6a" released by "_delete_snapshot" :: held 2.031s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-81d89f0f-f3e4-414a-b781-bb4ccecbda09" released by "delete_snapshot" :: held 2.051s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:33 devstack cinder-volume[82268]: WARNING cinder.quota [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1838671081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1838671081, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:33 devstack cinder-volume[82268]: WARNING cinder.quota [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1838671081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1838671081, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:33 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Created reservations ['a4effbd5-49b2-4c90-ae0f-72e085711214', 'e66c8d5b-4ffe-4069-b786-36fcf2a4beeb', 'de3e8591-4e20-441c-9c3e-0b9aa20dc8c7', '538a7a0c-8f9b-41de-adce-5e227889e38c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] Created reservations ['6c369f33-11fa-4bab-b005-f993e36a3675', 'be8ef50a-1783-4e02-9deb-fb89b92746cd', '890be6a9-21e6-45ff-869d-5231873fe880', 'c4119239-6230-4aac-b0b8-3be3afc4ea58'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-90b55cd5-f7be-4a53-b44e-375663e41a5d tempest-VolumesTransfersV355Test-806745956 None] Transfer volume completed successfully.
Apr 20 18:39:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-bcff3538-b034-47f7-a7ac-0ca0360903e7 tempest-GroupSnapshotsTest-895773677 None] group_snapshot aa7ae1a5-c28f-4194-9004-d8a90f035518: deleted successfully
Apr 20 18:39:34 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.453b3be3-8095-4012-aeb8-c290723fd755" returned: 0 in 0.589s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-453b3be3-8095-4012-aeb8-c290723fd755" released by "_delete_snapshot" :: held 2.248s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" released by "delete_snapshot" :: held 2.285s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Created reservations ['6802b13f-409e-4761-9deb-0976bb8bf7e6', '448e47ed-51c5-49a9-8ebd-b3475b65309c', '432db5b1-3b2b-4431-834d-bc414837f5dc', '05723daa-256c-4cc3-8e8a-91bb0bcf0f53'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Delete snapshot completed successfully.
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5dbe434-28f1-45ba-8bf6-e64270290961 tempest-SnapshotsActionsTest-722019588 None] Lock "cinder-453b3be3-8095-4012-aeb8-c290723fd755-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Acquiring lock "cinder-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Acquiring lock "cinder-quobyte-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-quobyte-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e363760-bd9e-4bc9-90bd-4cf987af6faf]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:35 devstack sudo[85145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2
Apr 20 18:39:35 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-81d89f0f-f3e4-414a-b781-bb4ccecbda09" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-81d89f0f-f3e4-414a-b781-bb4ccecbda09" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f839c-e5ec-4904-8250-a91be42942e6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:35 devstack sudo[85148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09
Apr 20 18:39:35 devstack sudo[85148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "cinder-81a81307-b057-4e08-b261-f8683e874318-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-81a81307-b057-4e08-b261-f8683e874318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "cinder-quobyte-81a81307-b057-4e08-b261-f8683e874318" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-quobyte-81a81307-b057-4e08-b261-f8683e874318" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Deleting offline snapshot 81a81307-b057-4e08-b261-f8683e874318 of volume 05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] snapshot_file for this snap is: volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a3e63-f56d-4300-9017-2ddfa45e43b0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:35 devstack sudo[85159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:35 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:35 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2" returned: 0 in 0.573s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:35 devstack sudo[85170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2
Apr 20 18:39:35 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:35 devstack sudo[85148]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09" returned: 0 in 0.593s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:35 devstack sudo[85176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09
Apr 20 18:39:35 devstack sudo[85176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:35 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05f73205-f783-4afc-a09a-77d52ec49605(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcd5967-89fc-428b-9b9c-8a86e2063400]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:35 devstack sudo[85181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605
Apr 20 18:39:35 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:36 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2" returned: 0 in 0.453s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-quobyte-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2" released by "delete_volume" :: held 1.076s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Created reservations ['af087649-0eac-4818-a051-da98d618efc0', 'd6b5136f-5a85-41d1-88b1-2f089f3177c4', 'd35ef098-826d-4fda-889d-14475a672621', 'b5d83516-ef96-4f5e-9384-fbfebd8dee26'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:36 devstack sudo[85184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:36 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:36 devstack sudo[85176]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-81d89f0f-f3e4-414a-b781-bb4ccecbda09" returned: 0 in 0.447s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-81d89f0f-f3e4-414a-b781-bb4ccecbda09" released by "delete_volume" :: held 1.073s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-b597a034-eb99-4cf9-979b-b938c7d0ce21" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-b597a034-eb99-4cf9-979b-b938c7d0ce21" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7591bc-c08e-4ddb-94f8-95b9cc9a4ec2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:36 devstack sudo[85187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21
Apr 20 18:39:36 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:36 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605" returned: 0 in 0.526s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:36 devstack sudo[85192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:36 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:36 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Deleted volume successfully.
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d5ad0037-aafc-419d-a32f-3a5528c891e5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-5b78aee5-5a4e-4ce5-8244-8993ab9eb5c2-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:36 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:36 devstack sudo[85198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21
Apr 20 18:39:36 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:36 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:36 devstack sudo[85203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318
Apr 20 18:39:36 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:37 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b597a034-eb99-4cf9-979b-b938c7d0ce21" returned: 0 in 0.453s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-b597a034-eb99-4cf9-979b-b938c7d0ce21" released by "delete_volume" :: held 1.025s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Created reservations ['4cc13ced-1523-4128-ba21-907fe16df801'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:37 devstack cinder-volume[82268]: WARNING cinder.quota [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1838671081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1838671081, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Flow 'volume_create_manager' (a16e046f-5ca1-47dc-9a96-270b3654cd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad74829-82b7-46bb-907f-93f861aad670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ad74829-82b7-46bb-907f-93f861aad670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1075925005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdcc361-f06f-4b7e-82c9-49eacb4855e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a4b70c88d8454692cb7fe0c0961994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:37Z,use_quota=True,user_id='dbc17b6fa0f746fe8ead188e969a5db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51051c0e-a414-49db-90ab-28293fd9450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:37 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51051c0e-a414-49db-90ab-28293fd9450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4279461b-5389-49b8-a312-fecaed547cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4279461b-5389-49b8-a312-fecaed547cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdcc361-f06f-4b7e-82c9-49eacb4855e7', 'volume_name': 'volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e669b4e-2543-484c-9bea-5ef424046f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e669b4e-2543-484c-9bea-5ef424046f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa4ca12-8c91-4681-ad2c-78b8aed5f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:37 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Volume 6bdcc361-f06f-4b7e-82c9-49eacb4855e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7', 'volume_size': 1}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1075925005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdcc361-f06f-4b7e-82c9-49eacb4855e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26a4b70c88d8454692cb7fe0c0961994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:37Z,use_quota=True,user_id='dbc17b6fa0f746fe8ead188e969a5db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Creating volume 6bdcc361-f06f-4b7e-82c9-49eacb4855e7 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:37 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605.81a81307-b057-4e08-b261-f8683e874318" returned: 0 in 0.559s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Created reservations ['85d3d28e-64fa-47b4-b870-f430258ce0f2', 'ff3c86c6-cc36-41ee-b2d9-d8fc641f8d92', 'e704dec8-18a4-4dba-96da-a2d8f5363998', 'd00f9eb5-142d-4afe-999e-897d643ab291'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:37 devstack sudo[85207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 1073741824
Apr 20 18:39:37 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-quobyte-81a81307-b057-4e08-b261-f8683e874318" released by "_delete_snapshot" :: held 2.128s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" released by "delete_snapshot" :: held 2.142s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Created reservations ['1ada3329-4633-48b6-b256-b6644c775634', '5eb0f3b1-ea3d-44d4-970f-d783511d9785', '77db1526-8486-42ce-a56b-bc7e4f5cad88', '0189fb0f-9efc-45a3-b7c4-2f2efebfd796'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:37 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Delete snapshot completed successfully.
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Created reservations ['9978734a-1770-40b5-9f8d-d03dc8d8c7b5', '638a2fa1-df0f-480d-972b-8f1a1b45de4f', '9f168cff-4be6-43cb-8981-c2e0d0c7b47c', '4bd2475a-c098-4876-b79e-477fa1eb9a6f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4ca73537-c308-474f-80ba-44f7cfc01642 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-81a81307-b057-4e08-b261-f8683e874318-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:37 devstack sudo[85209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:37 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:38 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 1073741824" returned: 0 in 0.574s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:38 devstack sudo[85214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7
Apr 20 18:39:38 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:38 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-48cb8f45-af3d-4f94-8ae2-54ba7f9d3f1d tempest-GroupSnapshotsTest-895773677 None] Delete group completed successfully.
Apr 20 18:39:38 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa4ca12-8c91-4681-ad2c-78b8aed5f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fd1ac0-319a-4a05-a1d2-0019a1ca643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:38 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Volume volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 (6bdcc361-f06f-4b7e-82c9-49eacb4855e7): created successfully
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02fd1ac0-319a-4a05-a1d2-0019a1ca643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Flow 'volume_create_manager' (a16e046f-5ca1-47dc-9a96-270b3654cd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d40a8997-7344-456c-88ad-42489d5e9624 tempest-VolumesTransfersV355Test-2009411738 None] Created volume successfully.
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "cinder-05f73205-f783-4afc-a09a-77d52ec49605-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-05f73205-f783-4afc-a09a-77d52ec49605-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d5c94b-db4d-465c-a013-99ef6eb60f38]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:38 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605
Apr 20 18:39:38 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3e6bf0a8-60b1-45dd-b08e-3c41056c6c48 tempest-GroupSnapshotsTest-895773677 None] Group tempest-GroupSnapshotsTest-Group-1407520802: creating
Apr 20 18:39:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3e6bf0a8-60b1-45dd-b08e-3c41056c6c48 tempest-GroupSnapshotsTest-895773677 None] Group tempest-GroupSnapshotsTest-Group-1407520802: created successfully
Apr 20 18:39:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3e6bf0a8-60b1-45dd-b08e-3c41056c6c48 tempest-GroupSnapshotsTest-895773677 None] Create group completed successfully.
Apr 20 18:39:39 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605" returned: 0 in 0.486s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:39 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605
Apr 20 18:39:39 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:39 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-05f73205-f783-4afc-a09a-77d52ec49605" returned: 0 in 0.411s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-quobyte-05f73205-f783-4afc-a09a-77d52ec49605" released by "delete_volume" :: held 0.931s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Created reservations ['d82fd7e0-bf76-4d76-aadb-0e77e3229843', '89818647-7a04-442a-853e-436e2e1314c8', '614a3cd0-38e8-47f3-973e-32e3bf077864', '0ec38156-7966-4bc0-9244-c97e2e491afe'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:39 devstack sudo[85227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:39 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Acquiring lock "cinder-6bdcc361-f06f-4b7e-82c9-49eacb4855e7-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-6bdcc361-f06f-4b7e-82c9-49eacb4855e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Acquiring lock "cinder-quobyte-6bdcc361-f06f-4b7e-82c9-49eacb4855e7" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-quobyte-6bdcc361-f06f-4b7e-82c9-49eacb4855e7" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e64370-f1e4-4839-8f2b-5938dc98c54b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:40 devstack sudo[85256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7
Apr 20 18:39:40 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (8e6721cf-915f-4dce-a345-69ceaec69902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5242270-f7c7-46de-82e6-f38eb26788a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5242270-f7c7-46de-82e6-f38eb26788a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1607353931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fd1e51d7-31f0-4e14-aef8-0a1a85de64db,host='devstack@QuobyteHD#QuobyteHD',id=efe49cf0-f2ff-4ec5-af40-e8f1b95ed073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:40Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba3b33df-98d5-4e6a-b82b-237d6985f1e1),volume_type_id=ba3b33df-98d5-4e6a-b82b-237d6985f1e1)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fe9a60-39a5-4490-a968-ae05121326fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fe9a60-39a5-4490-a968-ae05121326fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984b18bd-0e94-45fd-b66b-b6c21a328196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984b18bd-0e94-45fd-b66b-b6c21a328196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe49cf0-f2ff-4ec5-af40-e8f1b95ed073', 'volume_name': 'volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479f242a-035e-46be-98be-075f4136fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479f242a-035e-46be-98be-075f4136fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10abef3-adcf-4ab4-8b1e-88ae67409b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:40 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Volume efe49cf0-f2ff-4ec5-af40-e8f1b95ed073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073', 'volume_size': 1}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fd1e51d7-31f0-4e14-aef8-0a1a85de64db,created_at=2026-04-20T16:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1607353931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fd1e51d7-31f0-4e14-aef8-0a1a85de64db,host='devstack@QuobyteHD#QuobyteHD',id=efe49cf0-f2ff-4ec5-af40-e8f1b95ed073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651479bfb4774cf382df9b562dc6f2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:40Z,use_quota=True,user_id='806f3cefdf4f435c8e710cfd0e478b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba3b33df-98d5-4e6a-b82b-237d6985f1e1),volume_type_id=ba3b33df-98d5-4e6a-b82b-237d6985f1e1)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Creating volume efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:40 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:40 devstack sudo[85261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 1073741824
Apr 20 18:39:40 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:40 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.258s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:40 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Deleted volume successfully.
Apr 20 18:39:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6682df20-291e-482a-9d66-e6930907b631 tempest-SnapshotsActionsTest-593683348 None] Lock "cinder-05f73205-f783-4afc-a09a-77d52ec49605-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:41 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7" returned: 0 in 0.984s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:41 devstack sudo[85267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7
Apr 20 18:39:41 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:41 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 1073741824" returned: 0 in 0.874s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:41 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6bdcc361-f06f-4b7e-82c9-49eacb4855e7" returned: 0 in 0.490s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-quobyte-6bdcc361-f06f-4b7e-82c9-49eacb4855e7" released by "delete_volume" :: held 1.527s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:41 devstack sudo[85273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073
Apr 20 18:39:41 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Created reservations ['932ff6ae-4229-4573-96bc-39d06a94e8f8', '95e89216-7255-4b76-8fb5-d6366b477b24', '1033812c-271a-4f7b-972d-d99555ab7197', 'e28ca340-af40-4941-960f-9d5035058996'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:41 devstack sudo[85275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:41 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:42 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" returned: 0 in 0.768s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10abef3-adcf-4ab4-8b1e-88ae67409b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac4d2d2-8a44-43ea-9737-a047ed138bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:42 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Volume volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 (efe49cf0-f2ff-4ec5-af40-e8f1b95ed073): created successfully
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac4d2d2-8a44-43ea-9737-a047ed138bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Flow 'volume_create_manager' (8e6721cf-915f-4dce-a345-69ceaec69902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:42 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-24c92ab2-ba01-464c-ac61-c2513b61950e tempest-GroupSnapshotsTest-895773677 None] Created volume successfully.
Apr 20 18:39:42 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.774s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:42 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Deleted volume successfully.
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cc50da6-0d72-40a8-b866-86389c8ab2b5 tempest-VolumesTransfersV355Test-36691918 None] Lock "cinder-6bdcc361-f06f-4b7e-82c9-49eacb4855e7-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:42 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] GroupSnapshot f9bd549d-6cdc-43c9-b3c2-94dafdc7abee: creating.
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Group snapshot f9bd549d-6cdc-43c9-b3c2-94dafdc7abee: creating. {{(pid=82268) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Creating offline snapshot 6e91559b-e849-4aa9-86d1-c657975a45b6 of volume efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[faabedbf-0521-473d-bc47-97edd99e5b68]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:43 devstack sudo[85281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073
Apr 20 18:39:43 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:43 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" returned: 0 in 0.878s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:43 devstack sudo[85310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 1G
Apr 20 18:39:43 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:44 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 1G" returned: 0 in 0.726s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:44 devstack sudo[85315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6
Apr 20 18:39:44 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:45 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6" returned: 0 in 0.567s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:45 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:45 devstack sudo[85347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6
Apr 20 18:39:45 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:45 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6" returned: 0 in 0.532s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:45 devstack sudo[85372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info
Apr 20 18:39:45 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:46 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info" returned: 0 in 0.745s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:46 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:39:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:46 devstack sudo[85377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info
Apr 20 18:39:46 devstack sudo[85377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:47 devstack sudo[85377]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.info" returned: 0 in 0.620s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.160s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:47 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-eee988f7-95bf-4f46-97bf-a36eeafb39a9 tempest-GroupSnapshotsTest-895773677 None] group_snapshot f9bd549d-6cdc-43c9-b3c2-94dafdc7abee: created successfully
Apr 20 18:39:48 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] group_snapshot f9bd549d-6cdc-43c9-b3c2-94dafdc7abee: deleting
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] group_snapshot f9bd549d-6cdc-43c9-b3c2-94dafdc7abee: deleting {{(pid=82268) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-6e91559b-e849-4aa9-86d1-c657975a45b6" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-6e91559b-e849-4aa9-86d1-c657975a45b6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Deleting offline snapshot 6e91559b-e849-4aa9-86d1-c657975a45b6 of volume efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] snapshot_file for this snap is: volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c2301-ab34-4969-8a5d-f1ec537f4f33]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Flow 'volume_create_manager' (b63c8b7a-ea4e-4f60-b802-5f901c424de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55979060-d0d7-4d96-a221-c96ff2a1744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55979060-d0d7-4d96-a221-c96ff2a1744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-987401973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db41acaa-eeb6-42cb-a09e-31af6ff521da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80228a476f6e4887b695397742c8a5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:48Z,use_quota=True,user_id='41f38f49ee2549b0b81d5ed33ef0e0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f5f55f-4c11-4f37-ad20-054f82e96202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:48 devstack sudo[85388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6
Apr 20 18:39:48 devstack sudo[85388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f5f55f-4c11-4f37-ad20-054f82e96202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad73ae74-008a-45f6-a4a6-05c951768586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad73ae74-008a-45f6-a4a6-05c951768586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db41acaa-eeb6-42cb-a09e-31af6ff521da', 'volume_name': 'volume-db41acaa-eeb6-42cb-a09e-31af6ff521da', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f73e437-9d28-4042-8042-93ceac8d6a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f73e437-9d28-4042-8042-93ceac8d6a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8c2cd6-397a-48e2-bea6-70c3c969dfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Volume db41acaa-eeb6-42cb-a09e-31af6ff521da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db41acaa-eeb6-42cb-a09e-31af6ff521da', 'volume_size': 1}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-987401973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db41acaa-eeb6-42cb-a09e-31af6ff521da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80228a476f6e4887b695397742c8a5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:48Z,use_quota=True,user_id='41f38f49ee2549b0b81d5ed33ef0e0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Creating volume db41acaa-eeb6-42cb-a09e-31af6ff521da {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:48 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:48 devstack sudo[85390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da 1073741824
Apr 20 18:39:48 devstack sudo[85390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:48 devstack sudo[85388]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6" returned: 0 in 0.619s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f7fce-4935-4d5e-ab40-27de29f234f4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:49 devstack sudo[85390]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da 1073741824" returned: 0 in 0.542s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:49 devstack sudo[85399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da
Apr 20 18:39:49 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:49 devstack sudo[85398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073
Apr 20 18:39:49 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Flow 'volume_create_manager' (98a6959d-855e-47e1-ac69-4ea397ebacff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852ab16a-62d9-41cd-abc5-41cc2c1c2c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852ab16a-62d9-41cd-abc5-41cc2c1c2c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1568155621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e839db-be63-4461-b5ed-26997e068a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a076f31424834b0e17b864d4cb931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:49Z,use_quota=True,user_id='1b4fb27ce1944605965cc614c07d1c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d11c882-f5fb-46a0-b61e-3269ee5d92d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d11c882-f5fb-46a0-b61e-3269ee5d92d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff59996a-83ba-4310-a308-426533c207b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff59996a-83ba-4310-a308-426533c207b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e839db-be63-4461-b5ed-26997e068a5c', 'volume_name': 'volume-f1e839db-be63-4461-b5ed-26997e068a5c', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b245754e-e8f2-40dd-ad63-85fb930ab901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b245754e-e8f2-40dd-ad63-85fb930ab901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f75dbf-af41-4595-8648-654cf84b4361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:49 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Volume f1e839db-be63-4461-b5ed-26997e068a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e839db-be63-4461-b5ed-26997e068a5c', 'volume_size': 1}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:49 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" returned: 0 in 0.505s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:49 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1568155621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e839db-be63-4461-b5ed-26997e068a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a076f31424834b0e17b864d4cb931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:49Z,use_quota=True,user_id='1b4fb27ce1944605965cc614c07d1c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Creating volume f1e839db-be63-4461-b5ed-26997e068a5c {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:49 devstack sudo[85406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:49 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:49 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:49 devstack sudo[85408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c 1073741824
Apr 20 18:39:49 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8c2cd6-397a-48e2-bea6-70c3c969dfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db41acaa-eeb6-42cb-a09e-31af6ff521da', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd1c23a-6524-4f3d-9a4c-d5d47539904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:49 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Volume volume-db41acaa-eeb6-42cb-a09e-31af6ff521da (db41acaa-eeb6-42cb-a09e-31af6ff521da): created successfully
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd1c23a-6524-4f3d-9a4c-d5d47539904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Flow 'volume_create_manager' (b63c8b7a-ea4e-4f60-b802-5f901c424de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:49 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-50d75676-ebbb-40fd-ac09-e6335421663c tempest-VolumesTransfersV357Test-2058336074 None] Created volume successfully.
Apr 20 18:39:49 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:49 devstack sudo[85416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6
Apr 20 18:39:49 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:50 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c 1073741824" returned: 0 in 0.514s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:50 devstack sudo[85418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c
Apr 20 18:39:50 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:50 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073.6e91559b-e849-4aa9-86d1-c657975a45b6" returned: 0 in 0.436s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-6e91559b-e849-4aa9-86d1-c657975a45b6" released by "_delete_snapshot" :: held 2.091s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" released by "delete_snapshot" :: held 2.112s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:50 devstack cinder-volume[82268]: WARNING cinder.quota [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1843546420 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1843546420, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:50 devstack cinder-volume[82268]: WARNING cinder.quota [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1843546420 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1843546420, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] Created reservations ['470cf547-9c4d-4ca6-bd69-8048865ffdc1', '63d22094-71e8-4e7a-9223-025d88b6c976', 'f205c2cc-0d38-4f64-b35a-16e56143cf0f', '8d4fdc5f-5db3-4f3d-a01a-5e0de0352514'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:50 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c" returned: 0 in 0.424s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f75dbf-af41-4595-8648-654cf84b4361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e839db-be63-4461-b5ed-26997e068a5c', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b295d84-41d2-4a2b-8956-c4820b4e8257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3bd43c17-8f9f-4d0d-9f32-813bf0c5e718 tempest-GroupSnapshotsTest-895773677 None] group_snapshot f9bd549d-6cdc-43c9-b3c2-94dafdc7abee: deleted successfully
Apr 20 18:39:50 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Volume volume-f1e839db-be63-4461-b5ed-26997e068a5c (f1e839db-be63-4461-b5ed-26997e068a5c): created successfully
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b295d84-41d2-4a2b-8956-c4820b4e8257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Flow 'volume_create_manager' (98a6959d-855e-47e1-ac69-4ea397ebacff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b3cc3b70-69bf-4882-8c49-c859e9ba0abe tempest-VolumeQuotasAdminTestJSON-961786964 None] Created volume successfully.
Apr 20 18:39:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-bd8db70c-8fa2-421b-a368-f8d287382eaf tempest-VolumesTransfersV357Test-2009121884 None] Transfer volume completed successfully.
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "cinder-f1e839db-be63-4461-b5ed-26997e068a5c-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "cinder-f1e839db-be63-4461-b5ed-26997e068a5c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=210,cinder:SELECT=182,cinder:INSERT=58,cinder:DELETE=10 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=206,cinder:INSERT=50,cinder:UPDATE=187,cinder:DELETE=11 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "cinder-quobyte-f1e839db-be63-4461-b5ed-26997e068a5c" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "cinder-quobyte-f1e839db-be63-4461-b5ed-26997e068a5c" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b15f420-703a-4118-8c25-7acdc975bbb2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:51 devstack sudo[85424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c
Apr 20 18:39:51 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Acquiring lock "cinder-db41acaa-eeb6-42cb-a09e-31af6ff521da-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-db41acaa-eeb6-42cb-a09e-31af6ff521da-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "cinder-quobyte-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Acquiring lock "cinder-quobyte-db41acaa-eeb6-42cb-a09e-31af6ff521da" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-quobyte-db41acaa-eeb6-42cb-a09e-31af6ff521da" acquired by "delete_volume" :: waited 0.037s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a0cfb-50ae-44d3-8b01-5d0fe204801f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e48142-3d30-4e9d-8fe3-89914d032411]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:51 devstack sudo[85426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073
Apr 20 18:39:51 devstack sudo[85426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:51 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da
Apr 20 18:39:51 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:52 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c" returned: 0 in 0.660s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:52 devstack sudo[85433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c
Apr 20 18:39:52 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:52 devstack sudo[85426]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" returned: 0 in 0.519s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:52 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da" returned: 0 in 0.536s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:52 devstack sudo[85441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073
Apr 20 18:39:52 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:52 devstack sudo[85443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da
Apr 20 18:39:52 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:52 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Lock "cinder-quobyte-efe49cf0-f2ff-4ec5-af40-e8f1b95ed073" released by "delete_volume" :: held 0.991s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:52 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f1e839db-be63-4461-b5ed-26997e068a5c" returned: 0 in 0.630s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "cinder-quobyte-f1e839db-be63-4461-b5ed-26997e068a5c" released by "delete_volume" :: held 1.323s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Created reservations ['49eb6533-16ee-4fde-8c16-b95740dfc8e3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:52 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-db41acaa-eeb6-42cb-a09e-31af6ff521da" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:52 devstack cinder-volume[82268]: WARNING cinder.quota [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1843546420 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1843546420, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Created reservations ['8f1789a8-2110-47b3-847a-21c7fc4b72ce', '2c43292a-ed66-41f8-a9c7-6c880600de15', '7f9ad621-422d-4a70-8942-42e371a9e033', 'a16812e0-ddc3-4fa1-b2be-4ca88d0ba3b2'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-quobyte-db41acaa-eeb6-42cb-a09e-31af6ff521da" released by "delete_volume" :: held 1.112s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Created reservations ['2611e2d8-62a9-4940-b5d1-d82e5343ac15', 'cc404a06-5a21-46fb-8f33-3aa8e358f778', 'cf0e9fa5-229f-4a48-9d5a-e70b430cdb3f', '7fb90ee6-8f99-475f-b002-3f9b5eb899e6'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:53 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:53 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Created reservations ['6b1d4a98-3df9-4c1e-9fe5-6e8423729bd2', 'a0ce7ba0-59d7-4fb5-98d1-c488cb408c1a', '6524caa5-6d30-4b23-a979-dd4f1be6211e', 'cc5a86b9-6892-4f56-b8b0-0c89284aa8f8'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:53 devstack sudo[85450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:53 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:53 devstack sudo[85452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:53 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:53 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.501s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Deleted volume successfully.
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d61b656-33ea-491a-b3d6-c7b3ca6b2add tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "cinder-f1e839db-be63-4461-b5ed-26997e068a5c-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:53 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Deleted volume successfully.
Apr 20 18:39:53 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.464s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-90616cc9-0dc2-4dcf-9094-6b80d0502e69 tempest-GroupSnapshotsTest-895773677 None] Delete group completed successfully.
Apr 20 18:39:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-740e770b-a188-4426-b927-1fb92230e23c tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-db41acaa-eeb6-42cb-a09e-31af6ff521da-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Flow 'volume_create_manager' (100f606b-3d13-473a-a053-347930073ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9ce6af-20aa-4706-be6b-610d803caf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9ce6af-20aa-4706-be6b-610d803caf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1790504606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522f8d27-75b2-4f4f-81a8-dc5274f763f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a076f31424834b0e17b864d4cb931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:54Z,use_quota=True,user_id='1b4fb27ce1944605965cc614c07d1c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aa319e-7d10-423d-b6be-98efd49c53e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aa319e-7d10-423d-b6be-98efd49c53e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371d1ccf-bd1a-4517-8010-582e53d77bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371d1ccf-bd1a-4517-8010-582e53d77bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522f8d27-75b2-4f4f-81a8-dc5274f763f2', 'volume_name': 'volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54bdd16-e696-4960-82eb-dd0b704a882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54bdd16-e696-4960-82eb-dd0b704a882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008c0c86-e474-4503-a1dc-8b962ca7b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Volume 522f8d27-75b2-4f4f-81a8-dc5274f763f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2', 'volume_size': 1}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1790504606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522f8d27-75b2-4f4f-81a8-dc5274f763f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9a076f31424834b0e17b864d4cb931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:54Z,use_quota=True,user_id='1b4fb27ce1944605965cc614c07d1c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Creating volume 522f8d27-75b2-4f4f-81a8-dc5274f763f2 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:54 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:54 devstack sudo[85474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 1073741824
Apr 20 18:39:54 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Flow 'volume_create_manager' (d99225e7-a75a-4e97-a4f1-e4e00d1562cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7d6974-627e-4acb-971d-e86741c3efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7d6974-627e-4acb-971d-e86741c3efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1324074447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ae8077-27a3-4bdf-8930-7844114f117a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80228a476f6e4887b695397742c8a5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:54Z,use_quota=True,user_id='41f38f49ee2549b0b81d5ed33ef0e0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed4efcf-4300-45ef-a962-e9dd71724cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed4efcf-4300-45ef-a962-e9dd71724cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a35638-1243-4848-9c48-6df26e01af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a35638-1243-4848-9c48-6df26e01af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ae8077-27a3-4bdf-8930-7844114f117a', 'volume_name': 'volume-11ae8077-27a3-4bdf-8930-7844114f117a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ac8ab9-1208-429d-8e98-31e524fd817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ac8ab9-1208-429d-8e98-31e524fd817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1154d972-35b8-451f-89f0-fc5add4811ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:54 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Volume 11ae8077-27a3-4bdf-8930-7844114f117a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ae8077-27a3-4bdf-8930-7844114f117a', 'volume_size': 1}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:54 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 1073741824" returned: 0 in 0.602s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:54 devstack sudo[85479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2
Apr 20 18:39:54 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:55 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2" returned: 0 in 0.461s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1324074447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ae8077-27a3-4bdf-8930-7844114f117a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80228a476f6e4887b695397742c8a5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:54Z,use_quota=True,user_id='41f38f49ee2549b0b81d5ed33ef0e0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Creating volume 11ae8077-27a3-4bdf-8930-7844114f117a {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:55 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008c0c86-e474-4503-a1dc-8b962ca7b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e243d9-7505-43a5-b4f7-854d8417c4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:55 devstack sudo[85482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a 1073741824
Apr 20 18:39:55 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Volume volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 (522f8d27-75b2-4f4f-81a8-dc5274f763f2): created successfully
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e243d9-7505-43a5-b4f7-854d8417c4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Flow 'volume_create_manager' (100f606b-3d13-473a-a053-347930073ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3c69a945-f404-4c4b-8b38-1ae7b809c1e6 tempest-VolumeQuotasAdminTestJSON-961786964 None] Created volume successfully.
Apr 20 18:39:55 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a 1073741824" returned: 0 in 0.583s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:55 devstack sudo[85487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a
Apr 20 18:39:55 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:56 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a" returned: 0 in 0.507s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1154d972-35b8-451f-89f0-fc5add4811ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ae8077-27a3-4bdf-8930-7844114f117a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33495f9c-77e1-48c8-b168-b62fafd2aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:56 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Volume volume-11ae8077-27a3-4bdf-8930-7844114f117a (11ae8077-27a3-4bdf-8930-7844114f117a): created successfully
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33495f9c-77e1-48c8-b168-b62fafd2aadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Flow 'volume_create_manager' (d99225e7-a75a-4e97-a4f1-e4e00d1562cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:56 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c7202041-bfc4-4453-bf06-f2a067e0b6f2 tempest-VolumesTransfersV357Test-2058336074 None] Created volume successfully.
Apr 20 18:39:56 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-03536612-4d72-462f-89a1-f2007b421f6f tempest-VolumeQuotasAdminTestJSON-310981352 None] Transfer volume completed successfully.
Apr 20 18:39:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e8caaec3-1bf4-4b98-8325-010d8752727f tempest-GroupSnapshotsV319Test-1697112062 None] Group tempest-GroupSnapshotsV319Test-Group-1517824272: creating
Apr 20 18:39:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e8caaec3-1bf4-4b98-8325-010d8752727f tempest-GroupSnapshotsV319Test-1697112062 None] Group tempest-GroupSnapshotsV319Test-Group-1517824272: created successfully
Apr 20 18:39:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e8caaec3-1bf4-4b98-8325-010d8752727f tempest-GroupSnapshotsV319Test-1697112062 None] Create group completed successfully.
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Acquiring lock "cinder-522f8d27-75b2-4f4f-81a8-dc5274f763f2-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Lock "cinder-522f8d27-75b2-4f4f-81a8-dc5274f763f2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Acquiring lock "cinder-quobyte-522f8d27-75b2-4f4f-81a8-dc5274f763f2" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Lock "cinder-quobyte-522f8d27-75b2-4f4f-81a8-dc5274f763f2" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb75f5f-f13f-4059-8398-3c7e18ff027b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:57 devstack sudo[85495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2
Apr 20 18:39:57 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Acquiring lock "cinder-11ae8077-27a3-4bdf-8930-7844114f117a-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-11ae8077-27a3-4bdf-8930-7844114f117a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Acquiring lock "cinder-quobyte-11ae8077-27a3-4bdf-8930-7844114f117a" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-quobyte-11ae8077-27a3-4bdf-8930-7844114f117a" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[291ed500-1e06-4ba2-a070-165c19724194]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:57 devstack sudo[85497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a
Apr 20 18:39:57 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:57 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2" returned: 0 in 0.525s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:57 devstack sudo[85502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2
Apr 20 18:39:57 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:58 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a" returned: 0 in 0.716s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:58 devstack sudo[85533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a
Apr 20 18:39:58 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Flow 'volume_create_manager' (f0a03af6-e098-41b2-813c-44d01bacbfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30751784-32f3-449d-a1f2-ca8d2c87a579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30751784-32f3-449d-a1f2-ca8d2c87a579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417991638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1eb1cde-0dc1-42c4-bebf-9144a35181c7,host='devstack@QuobyteHD#QuobyteHD',id=af20132a-8b53-49ab-be44-a7312febed8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cf6aa340eb43af817640a9ebc4e048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:59Z,use_quota=True,user_id='74a83b67fdf0491b9d54c277873a7874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30dabac3-750a-470d-bbdb-6bf7e119786d),volume_type_id=30dabac3-750a-470d-bbdb-6bf7e119786d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dd2ef6-efb4-46eb-b4a0-ab794d10fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7dd2ef6-efb4-46eb-b4a0-ab794d10fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de2ea79-92af-48d6-a5bd-84ed8b33ef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de2ea79-92af-48d6-a5bd-84ed8b33ef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af20132a-8b53-49ab-be44-a7312febed8e', 'volume_name': 'volume-af20132a-8b53-49ab-be44-a7312febed8e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e367fda-4022-497b-8c3c-3f99552b9b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e367fda-4022-497b-8c3c-3f99552b9b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3767d2b9-153c-40f6-b57b-ee767a6f9b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:39:58 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Volume af20132a-8b53-49ab-be44-a7312febed8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af20132a-8b53-49ab-be44-a7312febed8e', 'volume_size': 1}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c1eb1cde-0dc1-42c4-bebf-9144a35181c7,created_at=2026-04-20T16:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417991638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1eb1cde-0dc1-42c4-bebf-9144a35181c7,host='devstack@QuobyteHD#QuobyteHD',id=af20132a-8b53-49ab-be44-a7312febed8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cf6aa340eb43af817640a9ebc4e048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:39:59Z,use_quota=True,user_id='74a83b67fdf0491b9d54c277873a7874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30dabac3-750a-470d-bbdb-6bf7e119786d),volume_type_id=30dabac3-750a-470d-bbdb-6bf7e119786d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Creating volume af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:39:58 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:58 devstack sudo[85538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e 1073741824
Apr 20 18:39:58 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:58 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-522f8d27-75b2-4f4f-81a8-dc5274f763f2" returned: 0 in 0.898s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Lock "cinder-quobyte-522f8d27-75b2-4f4f-81a8-dc5274f763f2" released by "delete_volume" :: held 1.469s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:58 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Created reservations ['e9f181bf-879b-4d7d-adab-bfdda0ba7e61', 'e212b04d-21a2-42a9-b31b-f76462d5ec91', '66ebbb19-506f-47fc-ac37-5e1c1366658a', '6d839a2c-0fb9-4c39-8fe3-f378dedea70f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:59 devstack sudo[85542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:59 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:59 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-11ae8077-27a3-4bdf-8930-7844114f117a" returned: 0 in 0.740s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-quobyte-11ae8077-27a3-4bdf-8930-7844114f117a" released by "delete_volume" :: held 1.494s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Created reservations ['781e7f92-399b-489c-854c-515d62f06db4', '210b2a80-cc49-48d8-a4ee-688f9ffb0ee0', '89de6b6f-91fa-4c34-9dca-70d13c62b6d2', '5c8d95f3-ce36-4f4a-9723-e26c74ad4c3e'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:59 devstack sudo[85544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:39:59 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:59 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.499s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Deleted volume successfully.
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-915d04ae-b181-4af0-86f2-0850757df1ce tempest-VolumeQuotasAdminTestJSON-936410751 None] Lock "cinder-522f8d27-75b2-4f4f-81a8-dc5274f763f2-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:39:59 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e 1073741824" returned: 0 in 0.868s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:39:59 devstack sudo[85550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e
Apr 20 18:39:59 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:39:59 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.616s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:39:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Deleted volume successfully.
Apr 20 18:39:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdfbf0c7-5e0e-438a-86cc-ba1931276fe6 tempest-VolumesTransfersV357Test-2073231210 None] Lock "cinder-11ae8077-27a3-4bdf-8930-7844114f117a-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:00 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e" returned: 0 in 0.503s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3767d2b9-153c-40f6-b57b-ee767a6f9b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af20132a-8b53-49ab-be44-a7312febed8e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240bea57-26c2-47ae-8b2a-95ffda29d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:00 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Volume volume-af20132a-8b53-49ab-be44-a7312febed8e (af20132a-8b53-49ab-be44-a7312febed8e): created successfully
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240bea57-26c2-47ae-8b2a-95ffda29d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Flow 'volume_create_manager' (f0a03af6-e098-41b2-813c-44d01bacbfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-dc0a4fdc-923d-49b6-8f1f-9cb21dad6669 tempest-GroupSnapshotsV319Test-1697112062 None] Created volume successfully.
Apr 20 18:40:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] GroupSnapshot e64d64bd-1797-4871-afd0-3ea6a23c62dd: creating.
Apr 20 18:40:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Group snapshot e64d64bd-1797-4871-afd0-3ea6a23c62dd: creating. {{(pid=82268) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Creating offline snapshot 5fc9b833-0be7-4d8f-8c34-2b08aa84832d of volume af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc480f28-e6a1-4f00-90a6-4225ff7fb870]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:01 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e
Apr 20 18:40:01 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:01 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e" returned: 0 in 0.874s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:01 devstack sudo[85561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d 1G
Apr 20 18:40:01 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:02 devstack sudo[85564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:02 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:02 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d 1G" returned: 0 in 1.003s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af20132a-8b53-49ab-be44-a7312febed8e -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:02 devstack sudo[85570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af20132a-8b53-49ab-be44-a7312febed8e -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d
Apr 20 18:40:02 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:03 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.733s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:03 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:03 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af20132a-8b53-49ab-be44-a7312febed8e -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d" returned: 0 in 0.611s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:03 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:40:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:03 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d
Apr 20 18:40:03 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:04 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d" returned: 0 in 0.555s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:04 devstack sudo[85580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info
Apr 20 18:40:04 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:04 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info" returned: 0 in 0.575s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:04 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 18:40:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:04 devstack sudo[85583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info
Apr 20 18:40:04 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Flow 'volume_create_manager' (01b4768c-2eea-41d1-8ded-fbf299a18149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24da4b16-f02a-4a2b-9eff-ae243ccc554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24da4b16-f02a-4a2b-9eff-ae243ccc554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-309033819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd4566a-5fea-4dc4-b6e1-140e9dbfc986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953a93ccdd774ada949f3d44334de832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:05Z,use_quota=True,user_id='7143210fb7144ba9b32ea8a6bf9bd456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18578f40-95e3-4694-978a-9671181cf16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18578f40-95e3-4694-978a-9671181cf16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679e75d2-e85a-4551-8598-ba691a5a2ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.image.glance [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Creating Keystone auth plugin from conf {{(pid=82268) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Flow 'volume_create_manager' (7a4a4fff-d496-4480-9fff-b2af47d21d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e37d633-3d7d-411c-ad6c-25a4a6437f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e37d633-3d7d-411c-ad6c-25a4a6437f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1799570322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d4ed5d-390f-46a3-851d-cd75c5560efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca2662db34f436b9808df6625e44e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:05Z,use_quota=True,user_id='763c8715fbbd45db946244ce9daec70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a4bf29-1c14-4414-8999-56ba773e3984),volume_type_id=c1a4bf29-1c14-4414-8999-56ba773e3984)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1862dc-68a3-4fbb-80d5-364dc6062af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1862dc-68a3-4fbb-80d5-364dc6062af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83718c60-6338-4fa8-8d47-ffb7a14da58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83718c60-6338-4fa8-8d47-ffb7a14da58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d4ed5d-390f-46a3-851d-cd75c5560efe', 'volume_name': 'volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86096397-9d2b-4110-8dc1-e065155bd5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86096397-9d2b-4110-8dc1-e065155bd5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a671fef0-cf81-4c91-ab59-6f764e9afac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Volume c5d4ed5d-390f-46a3-851d-cd75c5560efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe', 'volume_size': 1}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:05 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.info" returned: 0 in 0.562s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.257s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1799570322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d4ed5d-390f-46a3-851d-cd75c5560efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca2662db34f436b9808df6625e44e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:05Z,use_quota=True,user_id='763c8715fbbd45db946244ce9daec70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1a4bf29-1c14-4414-8999-56ba773e3984),volume_type_id=c1a4bf29-1c14-4414-8999-56ba773e3984)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Creating volume c5d4ed5d-390f-46a3-851d-cd75c5560efe {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:05 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:05 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe 1073741824
Apr 20 18:40:05 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679e75d2-e85a-4551-8598-ba691a5a2ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edd4566a-5fea-4dc4-b6e1-140e9dbfc986', 'volume_name': 'volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0b79a80>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bb5199-4ad8-46ee-80ae-a30f4b69cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bb5199-4ad8-46ee-80ae-a30f4b69cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b79e7a4-7105-452d-9265-2a01c9d9cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Volume edd4566a-5fea-4dc4-b6e1-140e9dbfc986: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0b79a80>}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Trying to clone edd4566a-5fea-4dc4-b6e1-140e9dbfc986 from image 176162cd-bd53-4e34-b5ee-78401d9b8736 at location (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]). {{(pid=82268) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 18:40:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-935dc9f7-5fa9-4032-8621-ec9e9a3151c5 tempest-GroupSnapshotsV319Test-1697112062 None] group_snapshot e64d64bd-1797-4871-afd0-3ea6a23c62dd: created successfully
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 18:40:05 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d0c879-ed60-44dd-a51b-a657177e94b1]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:05 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD
Apr 20 18:40:05 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:06 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe 1073741824" returned: 0 in 0.724s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:06 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe
Apr 20 18:40:06 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:06 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 is fetched for user 7143210fb7144ba9b32ea8a6bf9bd456. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5bed71-b05a-4192-a26f-51c4912d14c2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:06 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD
Apr 20 18:40:06 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:06 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe" returned: 0 in 0.517s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a671fef0-cf81-4c91-ab59-6f764e9afac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4c740a-c59b-4325-a828-6b26e43393a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:06 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Volume volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe (c5d4ed5d-390f-46a3-851d-cd75c5560efe): created successfully
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4c740a-c59b-4325-a828-6b26e43393a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Flow 'volume_create_manager' (7a4a4fff-d496-4480-9fff-b2af47d21d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] group_snapshot e64d64bd-1797-4871-afd0-3ea6a23c62dd: deleting
Apr 20 18:40:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0d811b98-c784-4e05-95a5-5d29dbb4a413 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Created volume successfully.
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] group_snapshot e64d64bd-1797-4871-afd0-3ea6a23c62dd: deleting {{(pid=82268) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "cinder-quobyte-af20132a-8b53-49ab-be44-a7312febed8e" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "cinder-quobyte-af20132a-8b53-49ab-be44-a7312febed8e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "cinder-quobyte-5fc9b833-0be7-4d8f-8c34-2b08aa84832d" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "cinder-quobyte-5fc9b833-0be7-4d8f-8c34-2b08aa84832d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Deleting offline snapshot 5fc9b833-0be7-4d8f-8c34-2b08aa84832d of volume af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] snapshot_file for this snap is: volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cced820-f365-4f84-9f52-e434b050cc78]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:06 devstack sudo[85628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d
Apr 20 18:40:06 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:06 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-309033819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd4566a-5fea-4dc4-b6e1-140e9dbfc986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953a93ccdd774ada949f3d44334de832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:05Z,use_quota=True,user_id='7143210fb7144ba9b32ea8a6bf9bd456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Creating volume edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:06 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:06 devstack sudo[85633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 1073741824
Apr 20 18:40:06 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:07 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d" returned: 0 in 0.709s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af20132a-8b53-49ab-be44-a7312febed8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f69b7f-1005-4082-9948-ca4765e85a0c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:07 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 1073741824" returned: 0 in 0.746s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:07 devstack sudo[85645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e
Apr 20 18:40:07 devstack sudo[85645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:07 devstack sudo[85650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:07 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:07 devstack sudo[85651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:07 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:08 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 0 in 0.665s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Attempting download of 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume edd4566a-5fea-4dc4-b6e1-140e9dbfc986. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 18:40:08 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.681s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f7b10c38-9113-4fb6-b7e1-0ae1e3c16112 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Retype volume completed successfully.
Apr 20 18:40:08 devstack sudo[85645]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e" returned: 0 in 0.948s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4af9e6-a1cd-4240-82bb-75490e031b43]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:08 devstack sudo[85665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d
Apr 20 18:40:08 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:08 devstack sudo[85666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb
Apr 20 18:40:08 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Acquiring lock "cinder-c5d4ed5d-390f-46a3-851d-cd75c5560efe-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "cinder-c5d4ed5d-390f-46a3-851d-cd75c5560efe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Acquiring lock "cinder-quobyte-c5d4ed5d-390f-46a3-851d-cd75c5560efe" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "cinder-quobyte-c5d4ed5d-390f-46a3-851d-cd75c5560efe" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ef23bd-e618-44bf-9785-989a64e7d1b4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:09 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d" returned: 0 in 0.697s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:09 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb" returned: 0 in 0.690s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:09 devstack sudo[85681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d
Apr 20 18:40:09 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe
Apr 20 18:40:09 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:09 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:09 devstack sudo[85684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb
Apr 20 18:40:09 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:09 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe" returned: 0 in 0.569s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:09 devstack sudo[85690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe
Apr 20 18:40:09 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:09 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e.5fc9b833-0be7-4d8f-8c34-2b08aa84832d" returned: 0 in 0.498s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "cinder-quobyte-5fc9b833-0be7-4d8f-8c34-2b08aa84832d" released by "_delete_snapshot" :: held 2.926s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "cinder-quobyte-af20132a-8b53-49ab-be44-a7312febed8e" released by "delete_snapshot" :: held 2.941s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:09 devstack cinder-volume[82268]: WARNING cinder.quota [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1834902050 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1834902050, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:40:09 devstack cinder-volume[82268]: WARNING cinder.quota [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1834902050 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1834902050, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] Created reservations ['0a512509-9333-4211-ac23-a67f66d48198', '167b154b-3829-468b-ae17-eda880d97b78', '13541c84-00c6-4719-8502-a87f835052a7', 'f7dce837-38ed-4590-b0bd-e05144525098'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:09 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb" returned: 1 in 0.632s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_ee09awfb' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeff37d5-9fbb-4d14-bddf-bc78c75e7cf4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:09 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-125c6beb-2028-47d8-b40b-32160081067e tempest-GroupSnapshotsV319Test-1697112062 None] group_snapshot e64d64bd-1797-4871-afd0-3ea6a23c62dd: deleted successfully
Apr 20 18:40:09 devstack sudo[85694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD
Apr 20 18:40:09 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "cinder-quobyte-af20132a-8b53-49ab-be44-a7312febed8e" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "cinder-quobyte-af20132a-8b53-49ab-be44-a7312febed8e" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[320531ef-dfa6-4fd3-8197-4775920d5c3a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:10 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c5d4ed5d-390f-46a3-851d-cd75c5560efe" returned: 0 in 0.679s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "cinder-quobyte-c5d4ed5d-390f-46a3-851d-cd75c5560efe" released by "delete_volume" :: held 1.274s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:10 devstack cinder-volume[82268]: WARNING cinder.quota [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:40:10 devstack cinder-volume[82268]: WARNING cinder.quota [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Created reservations ['0cb0822b-42c0-4a27-bedb-27cad5390142', 'c4a8ec1b-b5fb-44af-a957-5cd654718313', 'ef1281fd-bf20-4a0d-b922-af50a61be009', 'b84e5fec-97b2-4980-9323-e48aeed530e4'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:10 devstack sudo[85697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e
Apr 20 18:40:10 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:10 devstack sudo[85702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:10 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:10 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] 176162cd-bd53-4e34-b5ee-78401d9b8736 was qcow2, converting to raw {{(pid=82268) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 18:40:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:10 devstack sudo[85704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:10 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:11 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e" returned: 0 in 0.834s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:11 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.670s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:11 devstack sudo[85718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e
Apr 20 18:40:11 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Deleted volume successfully.
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7ff85e25-c9be-4ef7-97b3-b8b5499adb62 tempest-VolumeRetypeWithoutMigrationTest-548186251 None] Lock "cinder-c5d4ed5d-390f-46a3-851d-cd75c5560efe-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:11 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:11 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-af20132a-8b53-49ab-be44-a7312febed8e" returned: 0 in 0.695s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 0 in 1.220s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_nzhylkzydevstack@QuobyteHD, size 112.00 MB, duration 1.22 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:40:11 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Converted 112.00 MB image at 91.71 MB/s
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "cinder-quobyte-af20132a-8b53-49ab-be44-a7312febed8e" released by "delete_volume" :: held 1.643s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:11 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 1G
Apr 20 18:40:11 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Created reservations ['8a21257c-7df1-486c-b4f1-dd301dd531fa'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:11 devstack cinder-volume[82268]: WARNING cinder.quota [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1834902050 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1834902050, it is now deprecated. Please use the default quota class for default quota.
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Created reservations ['9ce53ed9-19ea-4cae-8b0d-d1ca21522101', 'f93bd1b2-9c68-4dcc-b53a-31f7c80d3f3d', 'f2223147-ed7c-408e-ba48-3abdd2e8ea3b', '0c10e623-8dd4-4414-801f-8579f354f429'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:11 devstack sudo[85738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:11 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:12 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.617s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:12 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:12 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 1G" returned: 0 in 0.792s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:12 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0be7d535-68e6-42b1-98ac-48267a8b7c5e tempest-GroupSnapshotsV319Test-1697112062 None] Delete group completed successfully.
Apr 20 18:40:12 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[389867a6-5cff-4660-8d09-b0f0ed1e34f5]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:12 devstack sudo[85745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:12 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:13 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 0 in 0.686s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:13 devstack sudo[85749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:13 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:14 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 1 in 0.746s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Downloaded image 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume edd4566a-5fea-4dc4-b6e1-140e9dbfc986 successfully. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 for user 7143210fb7144ba9b32ea8a6bf9bd456 is deleted. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Marking volume edd4566a-5fea-4dc4-b6e1-140e9dbfc986 as bootable. {{(pid=82268) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Copying metadata from image 176162cd-bd53-4e34-b5ee-78401d9b8736 to edd4566a-5fea-4dc4-b6e1-140e9dbfc986. {{(pid=82268) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Creating volume glance metadata for volume edd4566a-5fea-4dc4-b6e1-140e9dbfc986 backed by image 176162cd-bd53-4e34-b5ee-78401d9b8736 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82268) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b79e7a4-7105-452d-9265-2a01c9d9cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0b79a80>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02b4bc-7530-4894-b54f-61b0f7498e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:14 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Volume volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 (edd4566a-5fea-4dc4-b6e1-140e9dbfc986): created successfully
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf02b4bc-7530-4894-b54f-61b0f7498e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Flow 'volume_create_manager' (01b4768c-2eea-41d1-8ded-fbf299a18149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f0a2b501-8df5-4308-84bf-da97b0720353 tempest-VolumesExtendTest-1242911961 None] Created volume successfully.
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb6304d-5a65-4484-ab55-c6ee9b93d9b4]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:15 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:15 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:15 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 0 in 0.710s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:15 devstack sudo[85759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:15 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:16 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 1 in 1.304s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 2G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 2G" returned: 0 in 0.102s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.157s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:17 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5d83e145-688a-444b-be01-9aec464ba31e tempest-VolumesExtendTest-1242911961 None] Extend volume completed successfully.
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Flow 'volume_create_manager' (7e6f7487-0ccb-48d5-8ce1-71ddccd08833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7e36ec-8906-4887-8622-45decab13e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7e36ec-8906-4887-8622-45decab13e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:17Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cff970f-c4db-47e7-939b-cc62f11832c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273d465957d645ff964b5b2f98acad5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:18Z,use_quota=True,user_id='693a289eb5484fea840aa50ffffc047c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3161ae7-8b48-476d-87c2-d0846ef59119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3161ae7-8b48-476d-87c2-d0846ef59119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8119c444-31ab-4d13-b868-386000bc13ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:17 devstack cinder-volume[82268]: DEBUG cinder.image.glance [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Creating Keystone auth plugin from conf {{(pid=82268) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8119c444-31ab-4d13-b868-386000bc13ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1cff970f-c4db-47e7-939b-cc62f11832c5', 'volume_name': 'volume-1cff970f-c4db-47e7-939b-cc62f11832c5', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0be1660>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282b195f-f198-4311-9fcb-0f6bace0ad14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282b195f-f198-4311-9fcb-0f6bace0ad14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d125599d-92ae-4fbd-bd9b-66cdea881dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:18 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Volume 1cff970f-c4db-47e7-939b-cc62f11832c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1cff970f-c4db-47e7-939b-cc62f11832c5', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0be1660>}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Trying to clone 1cff970f-c4db-47e7-939b-cc62f11832c5 from image 176162cd-bd53-4e34-b5ee-78401d9b8736 at location (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]). {{(pid=82268) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-edd4566a-5fea-4dc4-b6e1-140e9dbfc986-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-edd4566a-5fea-4dc4-b6e1-140e9dbfc986-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 18:40:18 devstack cinder-volume[82268]: INFO cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-quobyte-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278e37e-f3fe-4f66-a2a4-2aa7533fafad]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7e446-96bb-478e-8265-9279e5131d41]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:18 devstack sudo[85806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD
Apr 20 18:40:18 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:18 devstack sudo[85807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:18 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:19 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 0 in 0.686s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:19 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:19 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 is fetched for user 693a289eb5484fea840aa50ffffc047c. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 18:40:19 devstack sudo[85814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:19 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:19 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c049b2-feea-4355-b39a-cdff45b501f5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:19 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD
Apr 20 18:40:19 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:20 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 1 in 0.845s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:20 devstack sudo[85827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986
Apr 20 18:40:20 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:20 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD" returned: 0 in 0.967s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:17Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cff970f-c4db-47e7-939b-cc62f11832c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='273d465957d645ff964b5b2f98acad5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:18Z,use_quota=True,user_id='693a289eb5484fea840aa50ffffc047c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Creating volume 1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:20 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:20 devstack sudo[85833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 1073741824
Apr 20 18:40:20 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:21 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" returned: 0 in 0.930s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-edd4566a-5fea-4dc4-b6e1-140e9dbfc986" released by "delete_volume" :: held 2.561s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Created reservations ['81b11573-4b64-4099-a6d2-aa10841a6d67', '3ef63123-a575-49a5-9dbd-795a1bfe8944', 'b89e245f-7b6e-46cc-8053-5ae9e8023959', 'ec8675c1-30ce-45d1-ba0f-2287feed0522'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:21 devstack sudo[85847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:21 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:21 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 1073741824" returned: 0 in 0.840s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:21 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:40:21 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:22 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.827s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:22 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Deleted volume successfully.
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c606018a-9526-45fe-bd9f-27b98d0aa875 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-edd4566a-5fea-4dc4-b6e1-140e9dbfc986-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Flow 'volume_create_manager' (6c91b734-bdd3-498b-ae29-8267f67c20a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95570b4-48aa-46f3-bf19-686adb08fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95570b4-48aa-46f3-bf19-686adb08fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-599629251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124a22cb-aab3-4782-86dd-03e8b612f894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953a93ccdd774ada949f3d44334de832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:22Z,use_quota=True,user_id='7143210fb7144ba9b32ea8a6bf9bd456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:22 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5854ef9d-6076-4e14-bf55-116d489ac567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5854ef9d-6076-4e14-bf55-116d489ac567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c8bc2b-9a4a-4391-9ce1-d30cf9eb6411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c8bc2b-9a4a-4391-9ce1-d30cf9eb6411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '124a22cb-aab3-4782-86dd-03e8b612f894', 'volume_name': 'volume-124a22cb-aab3-4782-86dd-03e8b612f894', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b75faf-39dc-491d-bb27-b3db5f62ff98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b75faf-39dc-491d-bb27-b3db5f62ff98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e4780e-3107-4583-8487-b7666dc3befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Volume 124a22cb-aab3-4782-86dd-03e8b612f894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-124a22cb-aab3-4782-86dd-03e8b612f894', 'volume_size': 1}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 0 in 0.991s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-599629251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=124a22cb-aab3-4782-86dd-03e8b612f894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953a93ccdd774ada949f3d44334de832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:22Z,use_quota=True,user_id='7143210fb7144ba9b32ea8a6bf9bd456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Creating volume 124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:22 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Attempting download of 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume 1cff970f-c4db-47e7-939b-cc62f11832c5. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 18:40:22 devstack sudo[85853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 1073741824
Apr 20 18:40:22 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51f3cd-27b2-4f3c-8359-615014048fc8]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:22 devstack sudo[85855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum
Apr 20 18:40:22 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Flow 'volume_create_manager' (94964b63-90d0-4e47-a2cd-3355cf28de08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e270979-e389-4495-8097-9e3fbff313d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e270979-e389-4495-8097-9e3fbff313d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1984781890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cbdc3b-f0ff-46ba-b5e7-ea46189fe158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d61a1275c84cf2ad30409160539811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:23Z,use_quota=True,user_id='ce3a39e8166c4366a3c23f2245303dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b416ac-43c1-42e6-8951-df1a8cc2fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b416ac-43c1-42e6-8951-df1a8cc2fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cecbec-d06b-4050-bba6-142f8e327506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cecbec-d06b-4050-bba6-142f8e327506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70cbdc3b-f0ff-46ba-b5e7-ea46189fe158', 'volume_name': 'volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7885c379-70cd-408c-88c5-dbd705bb5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7885c379-70cd-408c-88c5-dbd705bb5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5109dd-30ae-46ea-923b-443788b76806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Volume 70cbdc3b-f0ff-46ba-b5e7-ea46189fe158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158', 'volume_size': 1}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:23 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 1073741824" returned: 0 in 0.729s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:23 devstack sudo[85861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894
Apr 20 18:40:23 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:23 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum" returned: 0 in 0.771s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:23 devstack sudo[85864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum
Apr 20 18:40:23 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:23 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894" returned: 0 in 0.433s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.624s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1984781890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70cbdc3b-f0ff-46ba-b5e7-ea46189fe158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d61a1275c84cf2ad30409160539811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:23Z,use_quota=True,user_id='ce3a39e8166c4366a3c23f2245303dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Creating volume 70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:23 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e4780e-3107-4583-8487-b7666dc3befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-124a22cb-aab3-4782-86dd-03e8b612f894', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:23 devstack sudo[85867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 1073741824
Apr 20 18:40:23 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d77c44-8eb5-4a6b-a81d-45d7df370e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Volume volume-124a22cb-aab3-4782-86dd-03e8b612f894 (124a22cb-aab3-4782-86dd-03e8b612f894): created successfully
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d77c44-8eb5-4a6b-a81d-45d7df370e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Flow 'volume_create_manager' (6c91b734-bdd3-498b-ae29-8267f67c20a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:23 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c9bcf47a-580a-4b52-a9c7-4406e09d2de2 tempest-VolumesExtendTest-1242911961 None] Created volume successfully.
Apr 20 18:40:23 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum" returned: 1 in 0.496s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_8s90pmum' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2767471-89db-4eb1-956f-4d72c7fe13ae]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:23 devstack sudo[85871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD
Apr 20 18:40:23 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:24 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 1073741824" returned: 0 in 0.549s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:24 devstack sudo[85876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158
Apr 20 18:40:24 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:24 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] 176162cd-bd53-4e34-b5ee-78401d9b8736 was qcow2, converting to raw {{(pid=82268) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:24 devstack sudo[85881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:40:24 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:24 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.207s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5109dd-30ae-46ea-923b-443788b76806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf074c-d4bd-4605-a617-5f284d7ca1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Creating offline snapshot bfaf2df2-99a8-431a-8406-dac0dddbbf0e of volume 124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:24 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Volume volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 (70cbdc3b-f0ff-46ba-b5e7-ea46189fe158): created successfully
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf074c-d4bd-4605-a617-5f284d7ca1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Flow 'volume_create_manager' (94964b63-90d0-4e47-a2cd-3355cf28de08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[43de7fb5-0f30-47da-a46f-d749dbab4af1]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:24 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f6348d00-390d-4f1d-ae73-5573ab800e9c tempest-SnapshotMetadataTestJSON-464065987 None] Created volume successfully.
Apr 20 18:40:24 devstack sudo[85884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894
Apr 20 18:40:24 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:25 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894" returned: 0 in 0.749s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:25 devstack sudo[85900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e 1G
Apr 20 18:40:25 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:25 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 0 in 1.204s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:25 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_jblcqvmedevstack@QuobyteHD, size 112.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:40:25 devstack cinder-volume[82268]: INFO cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Converted 112.00 MB image at 92.85 MB/s
Apr 20 18:40:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:25 devstack sudo[85902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 1G
Apr 20 18:40:25 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e 1G" returned: 0 in 0.598s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124a22cb-aab3-4782-86dd-03e8b612f894 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:26 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:26 devstack sudo[85910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124a22cb-aab3-4782-86dd-03e8b612f894 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e
Apr 20 18:40:26 devstack sudo[85910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:26 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 1G" returned: 0 in 0.539s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a3f23-9d0e-4fde-9db2-b73610208cc3]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:26 devstack sudo[85912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:40:26 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:26 devstack sudo[85910]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-124a22cb-aab3-4782-86dd-03e8b612f894 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:26 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e is being set with open permissions: ugo+rw
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:26 devstack sudo[85917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e
Apr 20 18:40:26 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:26 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 0 in 0.663s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:27 devstack sudo[85921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:40:27 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:27 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e" returned: 0 in 0.639s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:27 devstack sudo[85924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info
Apr 20 18:40:27 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:27 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 1 in 0.630s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Downloaded image 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume 1cff970f-c4db-47e7-939b-cc62f11832c5 successfully. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 for user 693a289eb5484fea840aa50ffffc047c is deleted. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Marking volume 1cff970f-c4db-47e7-939b-cc62f11832c5 as bootable. {{(pid=82268) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Copying metadata from image 176162cd-bd53-4e34-b5ee-78401d9b8736 to 1cff970f-c4db-47e7-939b-cc62f11832c5. {{(pid=82268) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Creating volume glance metadata for volume 1cff970f-c4db-47e7-939b-cc62f11832c5 backed by image 176162cd-bd53-4e34-b5ee-78401d9b8736 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82268) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d125599d-92ae-4fbd-bd9b-66cdea881dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cff970f-c4db-47e7-939b-cc62f11832c5', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0be1660>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d437b4-e222-499d-a602-52713c5a2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:27 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Volume volume-1cff970f-c4db-47e7-939b-cc62f11832c5 (1cff970f-c4db-47e7-939b-cc62f11832c5): created successfully
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d437b4-e222-499d-a602-52713c5a2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Flow 'volume_create_manager' (7e6f7487-0ccb-48d5-8ce1-71ddccd08833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-de8cb665-52fd-45ed-b3ac-63adc87991d4 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Created volume successfully.
Apr 20 18:40:27 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:27 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info is being set with open permissions: ugo+rw
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:27 devstack sudo[85930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info
Apr 20 18:40:27 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:27 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Flow 'volume_create_manager' (5e3a0a38-7fdf-4119-a61a-aec88b93665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c850ccb4-e597-41f9-9950-a6f12aa0ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c850ccb4-e597-41f9-9950-a6f12aa0ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1417084447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faa0699-6b0c-4d2d-8570-fd86dc508abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce2903b88ff41fb9e172b830851f003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:28Z,use_quota=True,user_id='a5b71812dcb44711883aa771e09f24a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dad0845-cae6-4618-83b5-979b0a4d5b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dad0845-cae6-4618-83b5-979b0a4d5b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de33fd57-f446-4c16-81de-a2b6184ad4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de33fd57-f446-4c16-81de-a2b6184ad4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1faa0699-6b0c-4d2d-8570-fd86dc508abc', 'volume_name': 'volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcb49c1-781e-469c-9f6c-c8973fe82742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fcb49c1-781e-469c-9f6c-c8973fe82742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a010cf03-b51c-493a-8492-b7d0621f4e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:28 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Volume 1faa0699-6b0c-4d2d-8570-fd86dc508abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc', 'volume_size': 1}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:28 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.info" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.530s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.117s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Creating offline snapshot d1320d74-581e-46cb-8a2a-5ab58b0d1388 of volume 70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6b8c8295-0b71-4d04-8d54-340d75d9a011 tempest-VolumesExtendTest-1242911961 None] Create snapshot completed successfully
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[91001b96-fbad-44cb-9567-bd103651aa8f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:28 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158
Apr 20 18:40:28 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:28 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" returned: 0 in 0.527s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:28 devstack sudo[85938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 1G
Apr 20 18:40:28 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:29 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 1G" returned: 0 in 0.531s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:29 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388
Apr 20 18:40:29 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:29 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:29 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 is being set with open permissions: ugo+rw
Apr 20 18:40:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:29 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388
Apr 20 18:40:29 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:30 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:30 devstack sudo[85959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info
Apr 20 18:40:30 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:30 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:30 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info is being set with open permissions: ugo+rw
Apr 20 18:40:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:30 devstack sudo[85964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info
Apr 20 18:40:30 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:31 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.info" returned: 0 in 0.422s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.158s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1417084447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faa0699-6b0c-4d2d-8570-fd86dc508abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ce2903b88ff41fb9e172b830851f003',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:28Z,use_quota=True,user_id='a5b71812dcb44711883aa771e09f24a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Creating volume 1faa0699-6b0c-4d2d-8570-fd86dc508abc {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:31 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:31 devstack sudo[85967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc 1073741824
Apr 20 18:40:31 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:31 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8a1f98b4-fa9a-4587-8e3e-86578469a5a5 tempest-SnapshotMetadataTestJSON-464065987 None] Create snapshot completed successfully
Apr 20 18:40:31 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc 1073741824" returned: 0 in 0.520s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:31 devstack sudo[85972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc
Apr 20 18:40:31 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "cinder-d1320d74-581e-46cb-8a2a-5ab58b0d1388-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-d1320d74-581e-46cb-8a2a-5ab58b0d1388-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "cinder-quobyte-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-quobyte-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "cinder-quobyte-d1320d74-581e-46cb-8a2a-5ab58b0d1388" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-quobyte-d1320d74-581e-46cb-8a2a-5ab58b0d1388" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Deleting offline snapshot d1320d74-581e-46cb-8a2a-5ab58b0d1388 of volume 70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] snapshot_file for this snap is: volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4375d60-69d5-4b26-a401-e15f1c8aef61]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:31 devstack sudo[85974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388
Apr 20 18:40:32 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:32 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc" returned: 0 in 0.419s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.327s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a010cf03-b51c-493a-8492-b7d0621f4e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540758bd-0190-4d50-b157-0a9871c23b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7130e3b-5a63-41e7-9b80-492b454d2515]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:32 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Volume volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc (1faa0699-6b0c-4d2d-8570-fd86dc508abc): created successfully
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540758bd-0190-4d50-b157-0a9871c23b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Flow 'volume_create_manager' (5e3a0a38-7fdf-4119-a61a-aec88b93665a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0c93582c-4313-438e-97f3-c9a650fdd722 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Created volume successfully.
Apr 20 18:40:32 devstack sudo[85977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894
Apr 20 18:40:32 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:32 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388" returned: 0 in 0.495s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0125bc-b1d1-49b5-bedf-a443726051f4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:32 devstack sudo[85982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158
Apr 20 18:40:32 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:32 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e 2G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e 2G" returned: 0 in 0.084s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.601s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.667s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6586cf15-6e9e-4aa3-b8a9-476625dd260d tempest-VolumesExtendTest-1242911961 None] Extend volume completed successfully.
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6a2b4-85e0-4115-adba-daf3e9d4d2fc]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:32 devstack sudo[85992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:40:32 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:32 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" returned: 0 in 0.490s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:32 devstack sudo[85995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388
Apr 20 18:40:32 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:33 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:33 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:33 devstack sudo[86003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388
Apr 20 18:40:33 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:33 devstack sudo[86002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:40:33 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-bfaf2df2-99a8-431a-8406-dac0dddbbf0e-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Lock "cinder-bfaf2df2-99a8-431a-8406-dac0dddbbf0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-quobyte-124a22cb-aab3-4782-86dd-03e8b612f894" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-124a22cb-aab3-4782-86dd-03e8b612f894" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-quobyte-bfaf2df2-99a8-431a-8406-dac0dddbbf0e" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-bfaf2df2-99a8-431a-8406-dac0dddbbf0e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Deleting offline snapshot bfaf2df2-99a8-431a-8406-dac0dddbbf0e of volume 124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] snapshot_file for this snap is: volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[934107df-ef11-4818-85fe-ddf303ac6160]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:33 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e
Apr 20 18:40:33 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:33 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158.d1320d74-581e-46cb-8a2a-5ab58b0d1388" returned: 0 in 0.415s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-quobyte-d1320d74-581e-46cb-8a2a-5ab58b0d1388" released by "_delete_snapshot" :: held 1.903s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-quobyte-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" released by "delete_snapshot" :: held 1.918s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Created reservations ['50c0eb39-7093-42c1-ad00-4703e5c56332', '3d444e97-80fc-462f-9f56-5c24982c735c', 'dc85411d-a27e-4221-86db-49592700b356', '22a394a6-9375-4a01-b1f6-52fdce2eee16'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:33 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 1 in 0.538s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.057s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba', 'name': 'volume-1cff970f-c4db-47e7-939b-cc62f11832c5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6120d2a2-4682-4fd5-a273-1b4d63bc4c47', 'enforce_multipath': True} {{(pid=82268) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 18:40:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Delete snapshot completed successfully.
Apr 20 18:40:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8cf10be1-12ab-44a8-996d-a9f74093ebfe tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-d1320d74-581e-46cb-8a2a-5ab58b0d1388-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-43660787-9b33-436c-b791-b3ec18422b84 req-647486cf-7a4b-4fef-843f-eabe516ac045 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] attachment_update completed successfully.
Apr 20 18:40:34 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e" returned: 0 in 0.581s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-124a22cb-aab3-4782-86dd-03e8b612f894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3acb55-f4ea-46c7-8e93-20eb348da91e]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Acquiring lock "cinder-1faa0699-6b0c-4d2d-8570-fd86dc508abc-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "cinder-1faa0699-6b0c-4d2d-8570-fd86dc508abc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Acquiring lock "cinder-quobyte-1faa0699-6b0c-4d2d-8570-fd86dc508abc" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "cinder-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:34 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894
Apr 20 18:40:34 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "cinder-quobyte-1faa0699-6b0c-4d2d-8570-fd86dc508abc" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e704d0-4ed3-4f18-8cfa-52e9b0e69b14]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "cinder-quobyte-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-quobyte-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c9a31c-6d28-405a-90f8-875003b23c0d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:34 devstack sudo[86017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc
Apr 20 18:40:34 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:34 devstack sudo[86018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158
Apr 20 18:40:34 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:34 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:34 devstack sudo[86026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e
Apr 20 18:40:34 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:34 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc" returned: 0 in 0.510s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:34 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc
Apr 20 18:40:34 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:34 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" returned: 0 in 0.493s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:34 devstack sudo[86034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158
Apr 20 18:40:34 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:35 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e" returned: 0 in 0.479s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:35 devstack sudo[86041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e
Apr 20 18:40:35 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:35 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1faa0699-6b0c-4d2d-8570-fd86dc508abc" returned: 0 in 0.452s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "cinder-quobyte-1faa0699-6b0c-4d2d-8570-fd86dc508abc" released by "delete_volume" :: held 0.997s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:35 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-quobyte-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158" released by "delete_volume" :: held 0.957s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Created reservations ['6360fafd-574e-4954-b0d6-8454732dbb29', '54700e54-0692-49c0-958c-00f79992d301', 'b6592a91-2e13-47a6-ba2c-bc912d99fc1c', 'e5426714-634e-4c56-abfa-5fd31af1d69c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Created reservations ['7fcd88b6-46af-4003-aa52-b75e18365ad8', '8c5ce49f-9244-4b16-a20e-725fb59087d7', '42f16e91-d336-4d8b-bd12-be7364e6bd9a', 'b7c92f71-69ae-4159-82dd-c349f7e601d1'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:35 devstack sudo[86043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:35 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:35 devstack sudo[86045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:35 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:35 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894.bfaf2df2-99a8-431a-8406-dac0dddbbf0e" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-bfaf2df2-99a8-431a-8406-dac0dddbbf0e" released by "_delete_snapshot" :: held 2.167s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-124a22cb-aab3-4782-86dd-03e8b612f894" released by "delete_snapshot" :: held 2.178s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Created reservations ['a9ffa14a-957e-4fa9-b522-d8ec304e307d', '1cbffc90-60f7-4133-a581-12b0d76b1975', 'bb291005-0786-4dfe-a452-16dfb28ee6dc', '66bafafe-eccf-469e-84fd-4c4399aef091'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:35 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Delete snapshot completed successfully.
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0b8921a1-2906-4bea-b5da-8e7b9853120b tempest-VolumesExtendTest-1242911961 None] Lock "cinder-bfaf2df2-99a8-431a-8406-dac0dddbbf0e-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:35 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.418s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:35 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Deleted volume successfully.
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-45eda493-be74-40c6-a853-a6936bf57ea1 tempest-SnapshotMetadataTestJSON-464065987 None] Lock "cinder-70cbdc3b-f0ff-46ba-b5e7-ea46189fe158-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:35 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:35 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Deleted volume successfully.
Apr 20 18:40:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ef91cacb-4d38-4cac-82a1-50cbe242baf8 tempest-VolumeQuotasNegativeTestJSON-1226702720 None] Lock "cinder-1faa0699-6b0c-4d2d-8570-fd86dc508abc-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-124a22cb-aab3-4782-86dd-03e8b612f894-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-124a22cb-aab3-4782-86dd-03e8b612f894-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "cinder-quobyte-124a22cb-aab3-4782-86dd-03e8b612f894" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-124a22cb-aab3-4782-86dd-03e8b612f894" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:36 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[39afc88a-580f-4162-bbdd-6dd81e4fd480]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:36 devstack sudo[86053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894
Apr 20 18:40:36 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:37 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894" returned: 0 in 0.526s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:37 devstack sudo[86058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894
Apr 20 18:40:37 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:37 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-124a22cb-aab3-4782-86dd-03e8b612f894" returned: 0 in 0.464s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-quobyte-124a22cb-aab3-4782-86dd-03e8b612f894" released by "delete_volume" :: held 1.072s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Created reservations ['66883b39-8ee7-449e-aced-bf485c18771a', '6d5a44f2-0695-473c-970a-b6465f495714', '9038d818-5e32-4cd4-a537-f578bc22fe32', 'ea3da3f8-a23e-4796-9a2f-610fc8ac7a47'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:38 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:38 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:38 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.703s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Deleted volume successfully.
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-486bfa44-4bd8-4b12-9f4d-815c7521bc26 tempest-VolumesExtendTest-1242911961 None] Lock "cinder-124a22cb-aab3-4782-86dd-03e8b612f894-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Flow 'volume_create_manager' (11198093-3197-4898-a9db-eb10b86f6adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e5c31c-8885-4a28-8584-6fb105af380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e5c31c-8885-4a28-8584-6fb105af380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1401828797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632b38ef-9b83-45d6-8059-61850dc7db00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc122ed7c3d43ebb7673853dbc475fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:39Z,use_quota=True,user_id='f6d17a27d9ae42f681701196b6344c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c975a67d-11ad-4ac7-8c0e-6e381dcf1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c975a67d-11ad-4ac7-8c0e-6e381dcf1c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c375444e-3136-4510-b42a-36ba45239a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c375444e-3136-4510-b42a-36ba45239a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632b38ef-9b83-45d6-8059-61850dc7db00', 'volume_name': 'volume-632b38ef-9b83-45d6-8059-61850dc7db00', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95613f51-ce82-495c-b5c6-7d4ee40e7ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95613f51-ce82-495c-b5c6-7d4ee40e7ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b29a17-0bad-488b-b82a-0acdb1092310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:38 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Volume 632b38ef-9b83-45d6-8059-61850dc7db00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632b38ef-9b83-45d6-8059-61850dc7db00', 'volume_size': 1}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1401828797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632b38ef-9b83-45d6-8059-61850dc7db00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc122ed7c3d43ebb7673853dbc475fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:39Z,use_quota=True,user_id='f6d17a27d9ae42f681701196b6344c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Creating volume 632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:39 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:39 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 1073741824
Apr 20 18:40:39 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:39 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 1073741824" returned: 0 in 0.884s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:39 devstack sudo[86098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00
Apr 20 18:40:39 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:40 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00" returned: 0 in 0.694s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b29a17-0bad-488b-b82a-0acdb1092310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632b38ef-9b83-45d6-8059-61850dc7db00', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c03ae9-f522-4f7e-b683-b36774a40fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:40 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Volume volume-632b38ef-9b83-45d6-8059-61850dc7db00 (632b38ef-9b83-45d6-8059-61850dc7db00): created successfully
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c03ae9-f522-4f7e-b683-b36774a40fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Flow 'volume_create_manager' (11198093-3197-4898-a9db-eb10b86f6adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:40 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b1bed7ba-4f78-4fcd-8ada-f28fd9996df8 tempest-VolumesDeleteCascade-851755082 None] Created volume successfully.
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Creating offline snapshot 6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a of volume 632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c3604-da15-4bb1-bbfc-565def2f23ea]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:41 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00
Apr 20 18:40:41 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Flow 'volume_create_manager' (845b2c9d-dca9-4008-8922-e74c77acf080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8eb48c-878a-4fee-bb57-48cbf81db04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f8eb48c-878a-4fee-bb57-48cbf81db04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1772368545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea09fda6-381d-4fdb-8ff5-7c4488adbfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966425264d1b4688b2ff8fbbd41451ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:41Z,use_quota=True,user_id='5c5bd441cdbe477e94a0e56573518faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bb067e-6523-4258-b37e-ceae5ed3b1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bb067e-6523-4258-b37e-ceae5ed3b1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b73b47-7a82-4768-acb0-6bfece6e723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b73b47-7a82-4768-acb0-6bfece6e723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea09fda6-381d-4fdb-8ff5-7c4488adbfdc', 'volume_name': 'volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62747d59-1ad7-43cb-9a23-87c838f1b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62747d59-1ad7-43cb-9a23-87c838f1b600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500aa432-0782-4c81-9e97-1837de94f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Volume ea09fda6-381d-4fdb-8ff5-7c4488adbfdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc', 'volume_size': 1}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (7f78b9f0-7485-4ad9-8ef8-cff70e861499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e75c52-e922-4458-9595-1b5239f0c5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e75c52-e922-4458-9595-1b5239f0c5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1179301841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb476668-0917-4504-9805-b9e7367443c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:42Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95333a7-6651-49b5-9b1e-345d8822605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95333a7-6651-49b5-9b1e-345d8822605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7001a4-151e-4b14-b04e-5c3652332801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7001a4-151e-4b14-b04e-5c3652332801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb476668-0917-4504-9805-b9e7367443c8', 'volume_name': 'volume-eb476668-0917-4504-9805-b9e7367443c8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e445122b-6889-4bbf-a31c-7e431bc2b0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e445122b-6889-4bbf-a31c-7e431bc2b0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5c24c1-5c90-4c66-a09d-49bf1776812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Volume eb476668-0917-4504-9805-b9e7367443c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb476668-0917-4504-9805-b9e7367443c8', 'volume_size': 1}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:41 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00" returned: 0 in 0.703s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:42 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a 1G
Apr 20 18:40:42 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:42 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a 1G" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632b38ef-9b83-45d6-8059-61850dc7db00 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:42 devstack sudo[86114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632b38ef-9b83-45d6-8059-61850dc7db00 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:42 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:42 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632b38ef-9b83-45d6-8059-61850dc7db00 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:42 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a is being set with open permissions: ugo+rw
Apr 20 18:40:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:42 devstack sudo[86119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:42 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:43 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.418s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:43 devstack sudo[86122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info
Apr 20 18:40:43 devstack sudo[86122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:43 devstack sudo[86122]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info" returned: 0 in 0.450s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:43 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info is being set with open permissions: ugo+rw
Apr 20 18:40:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:43 devstack sudo[86126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info
Apr 20 18:40:43 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:44 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.info" returned: 0 in 0.392s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.976s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.645s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1772368545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea09fda6-381d-4fdb-8ff5-7c4488adbfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='966425264d1b4688b2ff8fbbd41451ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:41Z,use_quota=True,user_id='5c5bd441cdbe477e94a0e56573518faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Creating volume ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:44 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:44 devstack sudo[86129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc 1073741824
Apr 20 18:40:44 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:44 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-96c5a442-c513-40ac-bcec-d4592f68ec37 tempest-VolumesDeleteCascade-851755082 None] Create snapshot completed successfully
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:44 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc 1073741824" returned: 0 in 0.556s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:44 devstack sudo[86134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc
Apr 20 18:40:44 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:45 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" returned: 0 in 0.402s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.412s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1179301841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb476668-0917-4504-9805-b9e7367443c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:42Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Creating volume eb476668-0917-4504-9805-b9e7367443c8 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:45 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500aa432-0782-4c81-9e97-1837de94f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8c22ad-1510-49ef-980c-c75e009c3e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:45 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8 1073741824
Apr 20 18:40:45 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:45 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Volume volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc (ea09fda6-381d-4fdb-8ff5-7c4488adbfdc): created successfully
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8c22ad-1510-49ef-980c-c75e009c3e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Flow 'volume_create_manager' (845b2c9d-dca9-4008-8922-e74c77acf080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:45 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e1363454-a8f2-4b4f-b5b2-70f67791fce6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Created volume successfully.
Apr 20 18:40:45 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8 1073741824" returned: 0 in 0.551s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:45 devstack sudo[86170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8
Apr 20 18:40:45 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:46 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.630s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5c24c1-5c90-4c66-a09d-49bf1776812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb476668-0917-4504-9805-b9e7367443c8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3de9c-b60a-421e-a78c-86d721b90b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Creating offline snapshot 302570a7-cbe1-487c-acd5-48ec76772d59 of volume 632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[123280dd-4c1c-4aeb-8533-149efa428ac0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:46 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Volume volume-eb476668-0917-4504-9805-b9e7367443c8 (eb476668-0917-4504-9805-b9e7367443c8): created successfully
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb3de9c-b60a-421e-a78c-86d721b90b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (7f78b9f0-7485-4ad9-8ef8-cff70e861499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:46 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-04115c25-fd83-429f-9fdc-d2bc9dfdca42 tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:40:46 devstack sudo[86173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:46 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:46 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.488s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632b38ef-9b83-45d6-8059-61850dc7db00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:46 devstack sudo[86178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 1G
Apr 20 18:40:46 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:47 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 1G" returned: 0 in 0.644s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:47 devstack sudo[86202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59
Apr 20 18:40:47 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (82ad1b22-7276-4d8b-ac21-97b221d84d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e357a2-9575-44bf-adfd-4127160f49a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e357a2-9575-44bf-adfd-4127160f49a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-700308166',display_name='tempest-VolumesGetTest-Volume-1120998674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b8a4cf-0117-4ff3-8550-c067b2204230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:47Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa398262-bf96-4f73-981f-84b3f33e9a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa398262-bf96-4f73-981f-84b3f33e9a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbacb55e-8fe4-43a7-836a-bdbcf67a5c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbacb55e-8fe4-43a7-836a-bdbcf67a5c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b8a4cf-0117-4ff3-8550-c067b2204230', 'volume_name': 'volume-83b8a4cf-0117-4ff3-8550-c067b2204230', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ce6dca-e9ff-404b-9446-04be11486792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ce6dca-e9ff-404b-9446-04be11486792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252a3e09-7b57-44c7-bacf-8a8aca21e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:47 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Volume 83b8a4cf-0117-4ff3-8550-c067b2204230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b8a4cf-0117-4ff3-8550-c067b2204230', 'volume_size': 1}
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:47 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59" returned: 0 in 0.472s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:47 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 is being set with open permissions: ugo+rw
Apr 20 18:40:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:47 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59
Apr 20 18:40:47 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:48 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59" returned: 0 in 0.406s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.472s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Creating offline snapshot 9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 of volume ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da64214-52ff-4a76-9351-8eeae84084cb]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:48 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-9d90037b-c2d8-4810-a830-d02f22779902 tempest-VolumesDeleteCascade-851755082 None] Create snapshot completed successfully
Apr 20 18:40:48 devstack sudo[86211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc
Apr 20 18:40:48 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-632b38ef-9b83-45d6-8059-61850dc7db00-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-632b38ef-9b83-45d6-8059-61850dc7db00-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Performing cascade delete. {{(pid=82268) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 20 18:40:48 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" returned: 0 in 0.500s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-302570a7-cbe1-487c-acd5-48ec76772d59-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:48 devstack sudo[86216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 1G
Apr 20 18:40:48 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-302570a7-cbe1-487c-acd5-48ec76772d59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-302570a7-cbe1-487c-acd5-48ec76772d59" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-302570a7-cbe1-487c-acd5-48ec76772d59" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Deleting offline snapshot 302570a7-cbe1-487c-acd5-48ec76772d59 of volume 632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] snapshot_file for this snap is: volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[65774566-b18f-43e8-850b-f874016894f7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:49 devstack sudo[86218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59
Apr 20 18:40:49 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:49 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 1G" returned: 0 in 0.529s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:49 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5
Apr 20 18:40:49 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:49 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59" returned: 0 in 0.482s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632b38ef-9b83-45d6-8059-61850dc7db00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[16396c05-8113-49fe-acf5-521413366de5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:49 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:49 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:49 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" returned: 0 in 0.441s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:49 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 is being set with open permissions: ugo+rw
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:49 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5
Apr 20 18:40:49 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:49 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.483s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632b38ef-9b83-45d6-8059-61850dc7db00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:49 devstack sudo[86239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59
Apr 20 18:40:49 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:50 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" returned: 0 in 0.423s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:50 devstack sudo[86245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info
Apr 20 18:40:50 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:50 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:50 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59
Apr 20 18:40:50 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:50 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info" returned: 0 in 0.454s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:50 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info is being set with open permissions: ugo+rw
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:50 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info
Apr 20 18:40:50 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:50 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.302570a7-cbe1-487c-acd5-48ec76772d59" returned: 0 in 0.441s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-302570a7-cbe1-487c-acd5-48ec76772d59" released by "_delete_snapshot" :: held 1.919s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" released by "delete_snapshot" :: held 1.929s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Created reservations ['df5f7522-9254-4cc4-9575-e504fba2e906', 'a316c61a-1b52-449c-b0d2-87fe8cb75f03', '648b8f8e-927a-4480-919b-f87263cd45e5', 'b721339d-234a-43c5-8cfd-fb503d4c4a26'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Delete snapshot completed successfully.
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-302570a7-cbe1-487c-acd5-48ec76772d59-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Deleting offline snapshot 6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a of volume 632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] snapshot_file for this snap is: volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc36c03d-a4c5-4e8c-97ac-4e96addadacc]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:51 devstack sudo[86254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:51 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:51 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.info" returned: 0 in 0.447s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.862s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-700308166',display_name='tempest-VolumesGetTest-Volume-1120998674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b8a4cf-0117-4ff3-8550-c067b2204230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:47Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Creating volume 83b8a4cf-0117-4ff3-8550-c067b2204230 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:51 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:51 devstack sudo[86257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230 1073741824
Apr 20 18:40:51 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:51 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-03a1e53c-36c4-4e13-b3c5-b9fae533f62b tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Create snapshot completed successfully
Apr 20 18:40:51 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.487s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-632b38ef-9b83-45d6-8059-61850dc7db00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e39f9-dc11-4149-8876-97bcef58e6fe]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:51 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00
Apr 20 18:40:51 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:52 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230 1073741824" returned: 0 in 0.786s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=174,cinder:UPDATE=175,cinder:INSERT=52,cinder:DELETE=15 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=179,cinder:SELECT=163,cinder:INSERT=53,cinder:DELETE=11 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:52 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230
Apr 20 18:40:52 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:52 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00" returned: 0 in 0.727s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:52 devstack sudo[86300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:52 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "cinder-9badfbe5-d0ed-433f-82fd-4f8005fcbdd5-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-9badfbe5-d0ed-433f-82fd-4f8005fcbdd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "cinder-quobyte-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-quobyte-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "cinder-quobyte-9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-quobyte-9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Deleting offline snapshot 9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 of volume ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] snapshot_file for this snap is: volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa8c0a-3b99-4074-be04-c0d6690b29d4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:52 devstack sudo[86302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5
Apr 20 18:40:52 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:52 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230" returned: 0 in 0.680s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252a3e09-7b57-44c7-bacf-8a8aca21e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b8a4cf-0117-4ff3-8550-c067b2204230', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe277ef-1c69-4780-9b0c-3a9feec64445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:52 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Volume volume-83b8a4cf-0117-4ff3-8550-c067b2204230 (83b8a4cf-0117-4ff3-8550-c067b2204230): created successfully
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe277ef-1c69-4780-9b0c-3a9feec64445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (82ad1b22-7276-4d8b-ac21-97b221d84d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:52 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7f18dd7b-c925-4c6b-87f3-e509b6eaa744 tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:40:52 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.538s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:52 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a
Apr 20 18:40:52 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:53 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" returned: 0 in 0.631s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[848b5dcf-803f-4084-b8e3-bc7abfa3186f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:53 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc
Apr 20 18:40:53 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:53 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00.6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" returned: 0 in 0.519s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a" released by "_delete_snapshot" :: held 2.368s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" released by "delete_snapshot" :: held 2.381s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Created reservations ['df00eacc-12a8-4ba6-82bc-f60ad454f6ad', '921ce7aa-6c46-47e6-a5b6-affea8e5d7ce', '9fde1beb-039e-4def-b0df-d9196c054b86', 'ce81317b-fb91-4f20-80ec-31292d2aa9a3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Delete snapshot completed successfully.
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-6c52ca97-fb6e-4e8d-b0c9-bafed6d3fe8a-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Snapshots deleted, issuing volume delete {{(pid=82268) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cac23c-a51f-4096-a637-1a544c87fe53]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:53 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00
Apr 20 18:40:53 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:53 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" returned: 0 in 0.589s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:53 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5
Apr 20 18:40:53 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-83b8a4cf-0117-4ff3-8550-c067b2204230-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Lock "cinder-83b8a4cf-0117-4ff3-8550-c067b2204230-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-83b8a4cf-0117-4ff3-8550-c067b2204230" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-83b8a4cf-0117-4ff3-8550-c067b2204230" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e97d1-f37c-4ad2-9f30-0d42caccfe6c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:54 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00" returned: 0 in 0.624s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:54 devstack sudo[86329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00
Apr 20 18:40:54 devstack sudo[86329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:54 devstack sudo[86328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230
Apr 20 18:40:54 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:54 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" returned: 0 in 0.583s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:54 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5
Apr 20 18:40:54 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:54 devstack sudo[86329]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-632b38ef-9b83-45d6-8059-61850dc7db00" returned: 0 in 0.494s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-632b38ef-9b83-45d6-8059-61850dc7db00" released by "delete_volume" :: held 1.149s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Created reservations ['483be731-eb42-44b7-a277-4f42bf7f0d32', '802c0da8-0273-4d6e-9c75-926c58f07e48', '49adf042-4170-4c4a-a0cc-88e5f7b400fc', '85bbf7e2-e6e2-429a-8ff3-3f0dca64b6a1'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:54 devstack sudo[86341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:54 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:54 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230" returned: 0 in 0.769s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:54 devstack sudo[86343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230
Apr 20 18:40:54 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:55 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc.9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" returned: 0 in 0.622s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-quobyte-9badfbe5-d0ed-433f-82fd-4f8005fcbdd5" released by "_delete_snapshot" :: held 2.499s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-quobyte-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" released by "delete_snapshot" :: held 2.509s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Created reservations ['c3824e40-c3bc-43c0-a99d-09f2fe1b67f3', 'c0ddca86-806b-4c45-9559-6ea2fd41f16e', '2d5dec97-8da2-49a7-8d42-ea12f588ab93', '86cbebd9-4687-47a2-b4bb-0a34769426ae'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Delete snapshot completed successfully.
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-40c79c19-7ece-4d96-aac8-a1933fe66a9d tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-9badfbe5-d0ed-433f-82fd-4f8005fcbdd5-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:55 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Deleted volume successfully.
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cfc7729c-3c04-421a-829c-78ac39de4296 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-632b38ef-9b83-45d6-8059-61850dc7db00-delete_volume" released by "delete_volume" :: held 6.455s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:55 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-83b8a4cf-0117-4ff3-8550-c067b2204230" returned: 0 in 0.530s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-83b8a4cf-0117-4ff3-8550-c067b2204230" released by "delete_volume" :: held 1.324s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Created reservations ['37818e72-3572-4f8e-83d5-de93433cc4e1', 'd33a4df8-0e0c-4d31-b608-41a7d8ce4d51', '05279104-7a8a-465a-96b1-37f043f59992', 'd4d35997-f122-47cb-8f50-3f51f60681ea'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:55 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:55 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "cinder-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Flow 'volume_create_manager' (5e07c99b-2e38-4a0a-b2cc-c5c3ff8630c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e7b9d4-1734-46d2-bfed-e1282a45c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e7b9d4-1734-46d2-bfed-e1282a45c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1081666150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5eb466f-8c18-4b47-b346-f967dfaf2906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc122ed7c3d43ebb7673853dbc475fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:56Z,use_quota=True,user_id='f6d17a27d9ae42f681701196b6344c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a6fa1e-2ea5-4954-891c-ec9838a30b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a6fa1e-2ea5-4954-891c-ec9838a30b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39257e2a-5ec3-4670-be41-f36d3d833c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39257e2a-5ec3-4670-be41-f36d3d833c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5eb466f-8c18-4b47-b346-f967dfaf2906', 'volume_name': 'volume-a5eb466f-8c18-4b47-b346-f967dfaf2906', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458c4f9c-1c38-4f9d-a751-8f6b57eddb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458c4f9c-1c38-4f9d-a751-8f6b57eddb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5f28d-1879-4372-8ad2-28f307b80c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Volume a5eb466f-8c18-4b47-b346-f967dfaf2906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5eb466f-8c18-4b47-b346-f967dfaf2906', 'volume_size': 1}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1081666150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5eb466f-8c18-4b47-b346-f967dfaf2906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc122ed7c3d43ebb7673853dbc475fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:56Z,use_quota=True,user_id='f6d17a27d9ae42f681701196b6344c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Creating volume a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:40:55 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "cinder-quobyte-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:55 devstack sudo[86356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 1073741824
Apr 20 18:40:55 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-quobyte-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" acquired by "delete_volume" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3343ae-617c-4f48-bec0-2239ed4d6bb8]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:56 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.637s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:56 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:40:56 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc
Apr 20 18:40:56 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff0af59e-4cc9-47ce-bba4-da020dfa8154 tempest-VolumesGetTest-947807768 None] Lock "cinder-83b8a4cf-0117-4ff3-8550-c067b2204230-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-eb476668-0917-4504-9805-b9e7367443c8-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Lock "cinder-eb476668-0917-4504-9805-b9e7367443c8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-eb476668-0917-4504-9805-b9e7367443c8" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-eb476668-0917-4504-9805-b9e7367443c8" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cc6c80-120f-4af2-8ef1-8941e6add73d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:56 devstack sudo[86380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8
Apr 20 18:40:56 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:56 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 1073741824" returned: 0 in 0.735s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:56 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" returned: 0 in 0.685s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:56 devstack sudo[86409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:40:56 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:56 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc
Apr 20 18:40:56 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:57 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8" returned: 0 in 0.884s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:57 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:57 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8
Apr 20 18:40:57 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-quobyte-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc" released by "delete_volume" :: held 1.313s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Created reservations ['c8cfa514-bb6a-40ee-a22c-d26273b73b14', 'f74ca70a-4f8e-4a34-a159-d205906d7cb4', '7a82dff5-7d27-4974-ad4a-34c412ca82e7', '85a2d158-ff8c-4bfc-9d90-1d26a38b834f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:57 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.722s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:57 devstack sudo[86422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:57 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a5f28d-1879-4372-8ad2-28f307b80c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5eb466f-8c18-4b47-b346-f967dfaf2906', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37aebf9d-b3a7-4db5-8a70-b5c4de8434f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:57 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Volume volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 (a5eb466f-8c18-4b47-b346-f967dfaf2906): created successfully
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37aebf9d-b3a7-4db5-8a70-b5c4de8434f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Flow 'volume_create_manager' (5e07c99b-2e38-4a0a-b2cc-c5c3ff8630c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-036134ff-4c2a-494d-9fe3-942351b53807 tempest-VolumesDeleteCascade-851755082 None] Created volume successfully.
Apr 20 18:40:57 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-eb476668-0917-4504-9805-b9e7367443c8" returned: 0 in 0.701s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-eb476668-0917-4504-9805-b9e7367443c8" released by "delete_volume" :: held 1.611s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:57 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Created reservations ['f1a9d0f1-27bb-4ab2-84d8-cad886e8e5f2', '9529dbed-2252-425c-9f95-e0e3ee7fa57c', '9097dd08-d3ca-4c5c-a93a-582785ebda76', '023bfb3d-100a-4cc0-b557-d933ba11412a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:40:58 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.643s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:58 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Deleted volume successfully.
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0ba38bff-a618-4995-8669-c90e589ece21 tempest-VolumeSnapshotQuotasNegativeTestJSON-2058827359 None] Lock "cinder-ea09fda6-381d-4fdb-8ff5-7c4488adbfdc-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:40:58 devstack sudo[86431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Creating offline snapshot 43b1f812-3455-4703-8530-78c2b7389f36 of volume a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:40:58 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97cb13f-9098-4c94-9eb0-45e6ae1288c6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:58 devstack sudo[86433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:40:58 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:40:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (86e302b3-001b-43c7-9bda-a2e235c586ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d94a10-87aa-454f-ae8b-ccf7e1fbec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d94a10-87aa-454f-ae8b-ccf7e1fbec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-44720399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3418d54-6ce3-4b03-9c69-ac7db0c95938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:59Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7a9679-704d-46a8-969c-407b7f4d7a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7a9679-704d-46a8-969c-407b7f4d7a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd6e608-86fb-4498-9834-ea0b8d2bb377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd6e608-86fb-4498-9834-ea0b8d2bb377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'volume_name': 'volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c39994-4851-4844-8698-dd0b3acf02d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c39994-4851-4844-8698-dd0b3acf02d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0742611-2bb4-4231-95a4-55665b3970a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:40:59 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Volume c3418d54-6ce3-4b03-9c69-ac7db0c95938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'volume_size': 1}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:40:59 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.974s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:40:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:40:59 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096b75af-276c-4393-ad5a-ea3b14fc77af tempest-VolumesGetTest-947807768 None] Lock "cinder-eb476668-0917-4504-9805-b9e7367443c8-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.914s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:59 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 1G
Apr 20 18:40:59 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:40:59 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 1G" returned: 0 in 0.585s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:40:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:40:59 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36
Apr 20 18:40:59 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:00 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36" returned: 0 in 0.522s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:00 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 is being set with open permissions: ugo+rw
Apr 20 18:41:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:00 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36
Apr 20 18:41:00 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:00 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36" returned: 0 in 0.545s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:00 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info
Apr 20 18:41:00 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:01 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info" returned: 0 in 0.472s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:01 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info is being set with open permissions: ugo+rw
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:01 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info
Apr 20 18:41:01 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-d7814484-7ed9-47bc-9a22-a7732fea3863 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Terminate volume connection completed successfully.
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-d7814484-7ed9-47bc-9a22-a7732fea3863 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Deleting attachment 6120d2a2-4682-4fd5-a273-1b4d63bc4c47. {{(pid=82268) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 18:41:01 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.info" returned: 0 in 0.463s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.571s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.660s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-44720399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3418d54-6ce3-4b03-9c69-ac7db0c95938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:40:59Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Creating volume c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:01 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:01 devstack sudo[86485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 1073741824
Apr 20 18:41:01 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-03bfae43-23cf-41fe-bed1-2ec21a06ddb9 tempest-VolumesDeleteCascade-851755082 None] Create snapshot completed successfully
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "cinder-1cff970f-c4db-47e7-939b-cc62f11832c5-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-1cff970f-c4db-47e7-939b-cc62f11832c5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "cinder-quobyte-1cff970f-c4db-47e7-939b-cc62f11832c5" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-quobyte-1cff970f-c4db-47e7-939b-cc62f11832c5" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f8b45-810e-4b53-ab31-f72f0a83dfb4]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:02 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 1073741824" returned: 0 in 0.568s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:02 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:41:02 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:02 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:02 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:02 devstack sudo[86494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:02 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:02 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Flow 'volume_create_manager' (50b27e79-3ff8-4b12-8010-eed79a81c77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceda060b-e6be-4ea1-bfc8-92823512c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.515s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceda060b-e6be-4ea1-bfc8-92823512c03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-373812983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d3a8fc-29d0-4055-98ad-6137a40e83b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc122ed7c3d43ebb7673853dbc475fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43b1f812-3455-4703-8530-78c2b7389f36,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:03Z,use_quota=True,user_id='f6d17a27d9ae42f681701196b6344c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c39b18-e319-450a-8b7c-94c81d588177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:02 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c39b18-e319-450a-8b7c-94c81d588177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7091c9-a520-4fe5-987e-815a20f5ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7091c9-a520-4fe5-987e-815a20f5ffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54d3a8fc-29d0-4055-98ad-6137a40e83b2', 'volume_name': 'volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2', 'volume_size': 1, 'snapshot_id': '43b1f812-3455-4703-8530-78c2b7389f36'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19ba57d-3845-4247-9034-58a6d0ff73b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19ba57d-3845-4247-9034-58a6d0ff73b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee619ea2-bf73-483c-911c-67bf673da395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:02 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Volume 54d3a8fc-29d0-4055-98ad-6137a40e83b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2', 'volume_size': 1, 'snapshot_id': '43b1f812-3455-4703-8530-78c2b7389f36'}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0742611-2bb4-4231-95a4-55665b3970a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e9693c-6568-4cd4-a6a3-613896406358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 0 in 0.670s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-43b1f812-3455-4703-8530-78c2b7389f36-54d3a8fc-29d0-4055-98ad-6137a40e83b2" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:02 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Volume volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 (c3418d54-6ce3-4b03-9c69-ac7db0c95938): created successfully
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e9693c-6568-4cd4-a6a3-613896406358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (86e302b3-001b-43c7-9bda-a2e235c586ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-43b1f812-3455-4703-8530-78c2b7389f36-54d3a8fc-29d0-4055-98ad-6137a40e83b2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Creating volume 54d3a8fc-29d0-4055-98ad-6137a40e83b2 from snapshot 43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-54d3a8fc-29d0-4055-98ad-6137a40e83b2" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0ed9476d-25d4-481d-85a5-c3156ae39d4a tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-54d3a8fc-29d0-4055-98ad-6137a40e83b2" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] snapshot: 43b1f812-3455-4703-8530-78c2b7389f36, volume: 54d3a8fc-29d0-4055-98ad-6137a40e83b2,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:41:02 devstack sudo[86499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:41:02 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca731d0-c490-4111-8262-d6206e1535f3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:03 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36
Apr 20 18:41:03 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:03 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.783s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:03 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:03 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (e2672a9e-315c-4562-b1c7-35b47b13dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd4ae17-ce11-43e7-a540-ad589b225dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36" returned: 0 in 0.605s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 1 in 0.702s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5eb466f-8c18-4b47-b346-f967dfaf2906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f4263-cd63-4bc7-ad6b-d848d0c9609e]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:03 devstack sudo[86510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5
Apr 20 18:41:03 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd4ae17-ce11-43e7-a540-ad589b225dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845240493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35f02fe-08fb-42ab-bdec-6bfde7421d0e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c3418d54-6ce3-4b03-9c69-ac7db0c95938,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:04Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebec0639-1d31-45ba-9148-492f0547a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebec0639-1d31-45ba-9148-492f0547a45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9027e6b4-eae7-4e8d-8414-25b348a697b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9027e6b4-eae7-4e8d-8414-25b348a697b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c35f02fe-08fb-42ab-bdec-6bfde7421d0e', 'volume_name': 'volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e', 'volume_size': 1, 'source_volid': 'c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72e1285-e174-4247-9637-41be5f108be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72e1285-e174-4247-9637-41be5f108be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5bfccd7-ef4e-4680-a73e-9285bccd5919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:03 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Volume c35f02fe-08fb-42ab-bdec-6bfde7421d0e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e', 'volume_size': 1, 'source_volid': 'c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'source_volstatus': 'available'}
Apr 20 18:41:03 devstack sudo[86511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:41:03 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:04 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.521s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:04 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1cff970f-c4db-47e7-939b-cc62f11832c5" returned: 0 in 0.555s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-quobyte-1cff970f-c4db-47e7-939b-cc62f11832c5" released by "delete_volume" :: held 1.972s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:04 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2
Apr 20 18:41:04 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.quota [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Created reservations ['d47ed7eb-afd4-4afd-9a99-940c30ea0b28', '7bdf4aad-facb-4071-b80d-31b9ec3a517b', 'c66da3df-6444-4fe0-a985-eb65a230b408', 'c7ee356b-4e83-416f-ade8-8bed02a22666'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:04 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:04 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:04 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.680s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.manager [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:04 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Deleted volume successfully.
Apr 20 18:41:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-e7fcd09d-9336-48bf-a5fd-866bc38b308c req-f45afa56-9e8e-4e63-b034-238085df6c9e tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-1cff970f-c4db-47e7-939b-cc62f11832c5-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:06 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2" returned: 0 in 2.675s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cff453b-aacd-47e5-afe9-bf248612547b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:06 devstack sudo[86546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:41:06 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:07 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.745s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:07 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906, size 1024.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:41:07 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Converted 1024.00 MB image at 382.71 MB/s
Apr 20 18:41:07 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 is being set with open permissions: ugo+rw
Apr 20 18:41:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:07 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2
Apr 20 18:41:07 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:08 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2" returned: 0 in 0.568s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-54d3a8fc-29d0-4055-98ad-6137a40e83b2" released by "_copy_volume_from_snapshot" :: held 5.197s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-43b1f812-3455-4703-8530-78c2b7389f36-54d3a8fc-29d0-4055-98ad-6137a40e83b2" released by "_create_volume_from_snapshot" :: held 5.217s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.239s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.426s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:08 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Cloning volume c3418d54-6ce3-4b03-9c69-ac7db0c95938 to volume c35f02fe-08fb-42ab-bdec-6bfde7421d0e
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Creating offline snapshot 2874c601-0147-49a4-a5ba-d406821a96af of volume c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee619ea2-bf73-483c-911c-67bf673da395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2', 'volume_size': 1, 'snapshot_id': '43b1f812-3455-4703-8530-78c2b7389f36'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988501f8-6a6d-42d4-9ecf-4e2b7d6f78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa69a35f-a5cb-4f5f-b14d-a3965530b043]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Volume volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 (54d3a8fc-29d0-4055-98ad-6137a40e83b2): created successfully
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988501f8-6a6d-42d4-9ecf-4e2b7d6f78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Flow 'volume_create_manager' (50b27e79-3ff8-4b12-8010-eed79a81c77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-31313889-b3dc-4f01-a449-31e9628c04b9 tempest-VolumesDeleteCascade-851755082 None] Created volume successfully.
Apr 20 18:41:08 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:08 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:08 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.542s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:08 devstack sudo[86590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af 1G
Apr 20 18:41:08 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-a5eb466f-8c18-4b47-b346-f967dfaf2906-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:09 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af 1G" returned: 0 in 0.630s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-a5eb466f-8c18-4b47-b346-f967dfaf2906-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:09 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af
Apr 20 18:41:09 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Performing cascade delete. {{(pid=82268) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-43b1f812-3455-4703-8530-78c2b7389f36-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-43b1f812-3455-4703-8530-78c2b7389f36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-a5eb466f-8c18-4b47-b346-f967dfaf2906" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-a5eb466f-8c18-4b47-b346-f967dfaf2906" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-43b1f812-3455-4703-8530-78c2b7389f36" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-43b1f812-3455-4703-8530-78c2b7389f36" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Deleting offline snapshot 43b1f812-3455-4703-8530-78c2b7389f36 of volume a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] snapshot_file for this snap is: volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b65cd7c-37c4-4cf7-85fd-0915eb0664f3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:09 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36
Apr 20 18:41:09 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:09 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af" returned: 0 in 0.561s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:09 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af is being set with open permissions: ugo+rw
Apr 20 18:41:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:10 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af
Apr 20 18:41:10 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:10 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36" returned: 0 in 0.527s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5eb466f-8c18-4b47-b346-f967dfaf2906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccdfc57-eac9-4b3a-8476-8bb4118cba73]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:10 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:41:10 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:10 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:10 devstack sudo[86612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info
Apr 20 18:41:10 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:10 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.615s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:10 devstack sudo[86618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36
Apr 20 18:41:10 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:10 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:10 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info is being set with open permissions: ugo+rw
Apr 20 18:41:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:10 devstack sudo[86621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info
Apr 20 18:41:10 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:11 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:11 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36
Apr 20 18:41:11 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:11 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.info" returned: 0 in 0.486s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] snapshot: 2874c601-0147-49a4-a5ba-d406821a96af, volume: c35f02fe-08fb-42ab-bdec-6bfde7421d0e,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc234a9-05de-4be2-95a7-253a46d3537b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:11 devstack sudo[86629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af
Apr 20 18:41:11 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:11 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906.43b1f812-3455-4703-8530-78c2b7389f36" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-43b1f812-3455-4703-8530-78c2b7389f36" released by "_delete_snapshot" :: held 2.168s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-a5eb466f-8c18-4b47-b346-f967dfaf2906" released by "delete_snapshot" :: held 2.194s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Created reservations ['e185ddf5-cf55-472f-b0e7-f0307706cd5b', 'fefde5a6-8953-451d-b638-45d6670e14c2', 'e1ccc4c4-e19f-4d52-9950-b43fb7859d15', 'fca858e0-ea4c-4035-bded-5fe6079befce'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Delete snapshot completed successfully.
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-43b1f812-3455-4703-8530-78c2b7389f36-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Snapshots deleted, issuing volume delete {{(pid=82268) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-a5eb466f-8c18-4b47-b346-f967dfaf2906" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-a5eb466f-8c18-4b47-b346-f967dfaf2906" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca4963-7430-4094-aadd-a0fcee8525b9]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:11 devstack sudo[86632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:41:11 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:12 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af" returned: 0 in 0.577s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd8e7ab-592e-4218-851c-9546a04a0b1a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:12 devstack sudo[86637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:12 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:12 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.554s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:12 devstack sudo[86642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906
Apr 20 18:41:12 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:12 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.613s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:12 devstack sudo[86648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e
Apr 20 18:41:12 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:12 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-a5eb466f-8c18-4b47-b346-f967dfaf2906" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-a5eb466f-8c18-4b47-b346-f967dfaf2906" released by "delete_volume" :: held 1.092s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Created reservations ['a8476cb7-ab84-46c6-b0d3-4db30a42a5db', 'eda59727-0f97-4336-bf92-40d6f409c606', '28795787-33b2-4859-9730-dc8a06ca65d3', '0d89f67f-6086-4b41-9b9a-d9249a615c43'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:13 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:13 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-54d3a8fc-29d0-4055-98ad-6137a40e83b2-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-54d3a8fc-29d0-4055-98ad-6137a40e83b2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "cinder-quobyte-54d3a8fc-29d0-4055-98ad-6137a40e83b2" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:14 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.323s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-54d3a8fc-29d0-4055-98ad-6137a40e83b2" acquired by "delete_volume" :: waited 0.041s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Deleted volume successfully.
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[362bdeb3-97c4-4220-9ef2-15363840bc23]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2a44d19e-9559-43fb-a099-b4e1aa047ec8 tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-a5eb466f-8c18-4b47-b346-f967dfaf2906-delete_volume" released by "delete_volume" :: held 5.009s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:14 devstack sudo[86690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2
Apr 20 18:41:14 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:15 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" returned: 0 in 2.671s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:15 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ffcaa7-dafc-4fc3-9cb5-800ffb8f6a0c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:15 devstack sudo[86693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:15 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:15 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2" returned: 0 in 1.230s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:15 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2
Apr 20 18:41:15 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:16 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-54d3a8fc-29d0-4055-98ad-6137a40e83b2" returned: 0 in 0.529s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:16 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.777s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938, size 1024.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:41:16 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Converted 1024.00 MB image at 383.29 MB/s
Apr 20 18:41:16 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e is being set with open permissions: ugo+rw
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-quobyte-54d3a8fc-29d0-4055-98ad-6137a40e83b2" released by "delete_volume" :: held 1.846s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:16 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e
Apr 20 18:41:16 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Created reservations ['660d8516-94e5-43bd-a0b5-2b5e3b41df77', 'ad047350-3295-4f00-bbb3-81d3f10051d0', 'c239bcf6-853f-452e-acd2-73858532876f', 'f4adad5c-299a-4e85-953a-78845c533f86'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:16 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:16 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:16 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" returned: 0 in 0.612s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" released by "_copy_volume_from_snapshot" :: held 5.327s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-98278335-c9b1-4b82-9dbc-cee8236b77c2 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Terminate volume connection completed successfully.
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-98278335-c9b1-4b82-9dbc-cee8236b77c2 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Deleting attachment 99675bcc-8bc3-47bd-9d54-72564d113ace. {{(pid=82268) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-2874c601-0147-49a4-a5ba-d406821a96af" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-2874c601-0147-49a4-a5ba-d406821a96af" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:16 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Deleting offline snapshot 2874c601-0147-49a4-a5ba-d406821a96af of volume c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] snapshot_file for this snap is: volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.657s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Deleted volume successfully.
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c50278-5dcc-4585-a94b-81065b5996de]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ac0469ac-6d9c-4137-87b6-3358817f658e tempest-VolumesDeleteCascade-851755082 None] Lock "cinder-54d3a8fc-29d0-4055-98ad-6137a40e83b2-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:17 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af
Apr 20 18:41:17 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "cinder-7dba65af-9fa8-43dc-8e03-c1fb2d045175-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-7dba65af-9fa8-43dc-8e03-c1fb2d045175-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "cinder-quobyte-7dba65af-9fa8-43dc-8e03-c1fb2d045175" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-quobyte-7dba65af-9fa8-43dc-8e03-c1fb2d045175" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f112e-e95d-4b29-b0a5-e4d0300ce894]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:17 devstack sudo[86751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175
Apr 20 18:41:17 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:17 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af" returned: 0 in 0.705s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8163776-34d8-49e4-9146-488f14c8c3d2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:17 devstack sudo[86754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:17 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:18 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175" returned: 0 in 0.627s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:18 devstack sudo[86760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175
Apr 20 18:41:18 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:18 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.662s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:18 devstack sudo[86765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af
Apr 20 18:41:18 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:18 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7dba65af-9fa8-43dc-8e03-c1fb2d045175" returned: 0 in 0.624s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-quobyte-7dba65af-9fa8-43dc-8e03-c1fb2d045175" released by "delete_volume" :: held 1.278s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG cinder.quota [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Created reservations ['3f354088-323c-4bbf-9091-5c85cc3d961f', 'f5e92474-4011-4c87-b140-e435353a094f', '33137052-fc4f-4879-8013-5f4459fa5742', '9e6fa19c-aa0c-4e8b-bc93-3bdf609c3ea9'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:18 devstack sudo[86771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:18 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:18 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af" returned: 0 in 0.655s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:18 devstack sudo[86773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af
Apr 20 18:41:18 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:19 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.535s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.manager [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:19 devstack cinder-volume[82268]: INFO cinder.volume.manager [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Deleted volume successfully.
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [req-07911e75-976f-4b9b-80ed-f6d4cf154333 req-68da4c7d-f2e8-46c5-8d2f-a129a2588270 tempest-ServerBootFromVolumeStableRescueTest-1658290511 None] Lock "cinder-7dba65af-9fa8-43dc-8e03-c1fb2d045175-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:19 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938.2874c601-0147-49a4-a5ba-d406821a96af" returned: 0 in 0.698s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-2874c601-0147-49a4-a5ba-d406821a96af" released by "_delete_snapshot" :: held 2.799s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.521s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5bfccd7-ef4e-4680-a73e-9285bccd5919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e', 'volume_size': 1, 'source_volid': 'c3418d54-6ce3-4b03-9c69-ac7db0c95938', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb3cd9d-ae2d-43d4-9598-2019c7bfdf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:19 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Volume volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e (c35f02fe-08fb-42ab-bdec-6bfde7421d0e): created successfully
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb3cd9d-ae2d-43d4-9598-2019c7bfdf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (e2672a9e-315c-4562-b1c7-35b47b13dae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:19 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-edf19eb2-c965-4eae-ae4f-ddd7e0759cc7 tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (3d7d28ff-b615-4d92-a1d2-9a6c9d8e00a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4d19b6-1700-4f5f-babf-5aed1c803ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4d19b6-1700-4f5f-babf-5aed1c803ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1694944413',display_name='tempest-VolumesGetTest-Volume-1752501452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d85fe1-8cf3-4daa-8875-d61f99a2586d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:21Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5c2d3c-9b84-4b35-a9d1-15af00498709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5c2d3c-9b84-4b35-a9d1-15af00498709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc618db-18a8-4a95-b158-1215eeb222bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc618db-18a8-4a95-b158-1215eeb222bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d85fe1-8cf3-4daa-8875-d61f99a2586d', 'volume_name': 'volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c29d3f-ab71-40b1-bb9b-53d2c75240a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c29d3f-ab71-40b1-bb9b-53d2c75240a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d4a1b2-3ddf-433b-ac52-0a4c6eb39d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:21 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Volume 04d85fe1-8cf3-4daa-8875-d61f99a2586d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d', 'volume_size': 1}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1694944413',display_name='tempest-VolumesGetTest-Volume-1752501452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d85fe1-8cf3-4daa-8875-d61f99a2586d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:21Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Creating volume 04d85fe1-8cf3-4daa-8875-d61f99a2586d {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:21 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:21 devstack sudo[86779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d 1073741824
Apr 20 18:41:21 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:21 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d 1073741824" returned: 0 in 0.603s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:21 devstack sudo[86793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d
Apr 20 18:41:21 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:22 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d" returned: 0 in 0.580s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d4a1b2-3ddf-433b-ac52-0a4c6eb39d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df2f9ee-1355-40dc-9e0b-dbda7d627302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Volume volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d (04d85fe1-8cf3-4daa-8875-d61f99a2586d): created successfully
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df2f9ee-1355-40dc-9e0b-dbda7d627302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (3d7d28ff-b615-4d92-a1d2-9a6c9d8e00a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:22 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-be1fb8ba-ec71-4226-b1b7-a665fe30c60e tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:41:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-04d85fe1-8cf3-4daa-8875-d61f99a2586d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Lock "cinder-04d85fe1-8cf3-4daa-8875-d61f99a2586d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-04d85fe1-8cf3-4daa-8875-d61f99a2586d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-04d85fe1-8cf3-4daa-8875-d61f99a2586d" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:23 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ee8ba9-bc9b-4fbf-9bc8-bd1ee51129e6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:23 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d
Apr 20 18:41:23 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:24 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d" returned: 0 in 0.568s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:24 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d
Apr 20 18:41:24 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:24 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-04d85fe1-8cf3-4daa-8875-d61f99a2586d" returned: 0 in 0.505s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-04d85fe1-8cf3-4daa-8875-d61f99a2586d" released by "delete_volume" :: held 1.107s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Created reservations ['4845733a-5186-4c7c-9b97-10d01ca8add1', '2b91ddc0-4c59-461b-8acf-c413d6a1099e', '097363df-31d8-4bf7-bbee-411f10f37954', '016363ca-e4d7-479e-8696-c34cf4875e9c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:24 devstack sudo[86827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:24 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:25 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.597s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f56e3519-81ec-4d83-94dd-846b8360f089 tempest-VolumesGetTest-947807768 None] Lock "cinder-04d85fe1-8cf3-4daa-8875-d61f99a2586d-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Flow 'volume_create_manager' (7a297441-6937-4726-bed3-7b18049ba6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da04a65-7eaf-4205-a168-75ef4b91ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da04a65-7eaf-4205-a168-75ef4b91ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-474114900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add0b8d1-5d29-4ef2-9b1d-ce1d9745290b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a5cdecc7942d7ad7285b100939c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:26Z,use_quota=True,user_id='53de74dd39d749d7b3c7cbfe58e35eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a951396-912f-4497-9a3f-1d343947829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a951396-912f-4497-9a3f-1d343947829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25169495-e1d5-4e34-9471-9827031e4941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25169495-e1d5-4e34-9471-9827031e4941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add0b8d1-5d29-4ef2-9b1d-ce1d9745290b', 'volume_name': 'volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1befde-9f27-468e-8120-f77ad8bfa09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1befde-9f27-468e-8120-f77ad8bfa09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f94ad5a-a7c1-4492-83bd-5edcd5b07e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:25 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Volume add0b8d1-5d29-4ef2-9b1d-ce1d9745290b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b', 'volume_size': 1}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-474114900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add0b8d1-5d29-4ef2-9b1d-ce1d9745290b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc6a5cdecc7942d7ad7285b100939c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:26Z,use_quota=True,user_id='53de74dd39d749d7b3c7cbfe58e35eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Creating volume add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:25 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:25 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b 1073741824
Apr 20 18:41:25 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-c35f02fe-08fb-42ab-bdec-6bfde7421d0e-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Lock "cinder-c35f02fe-08fb-42ab-bdec-6bfde7421d0e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732dfc3-3aae-4a7b-b71d-e04eaeeef1b5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:25 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e
Apr 20 18:41:25 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:26 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b 1073741824" returned: 0 in 0.711s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:26 devstack sudo[86842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:41:26 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:26 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" returned: 0 in 0.677s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:26 devstack sudo[86844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e
Apr 20 18:41:26 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:26 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.522s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f94ad5a-a7c1-4492-83bd-5edcd5b07e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e442bb6-e7fb-4427-8c74-ea9693ff23cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:26 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Volume volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b (add0b8d1-5d29-4ef2-9b1d-ce1d9745290b): created successfully
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e442bb6-e7fb-4427-8c74-ea9693ff23cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Flow 'volume_create_manager' (7a297441-6937-4726-bed3-7b18049ba6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:26 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3928bf11-c28f-45d0-936f-d7d469047e1d tempest-VolumesActionsTest-359768699 None] Created volume successfully.
Apr 20 18:41:26 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-c35f02fe-08fb-42ab-bdec-6bfde7421d0e" released by "delete_volume" :: held 1.171s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Created reservations ['d31f7ecf-5f6b-4c6e-a25f-a9c23ec938e5', 'f5e57573-70fc-4ef7-a5dc-587db69c6ddf', 'a3924731-b69d-4cb6-813c-8eefa4f5fde4', '866dec2f-9f53-4632-ae2c-980b537931f0'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:27 devstack sudo[86848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:27 devstack sudo[86848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:27 devstack sudo[86848]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.527s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:41:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99f9c382-2645-45c3-8200-3e01db4cfcac tempest-VolumesGetTest-947807768 None] Lock "cinder-c35f02fe-08fb-42ab-bdec-6bfde7421d0e-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-c3418d54-6ce3-4b03-9c69-ac7db0c95938-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Lock "cinder-c3418d54-6ce3-4b03-9c69-ac7db0c95938-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-c3418d54-6ce3-4b03-9c69-ac7db0c95938" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-c3418d54-6ce3-4b03-9c69-ac7db0c95938" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce907f1-120e-4c56-a005-7dc758156e3c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:28 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:28 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:28 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.627s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:28 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938
Apr 20 18:41:28 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:29 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c3418d54-6ce3-4b03-9c69-ac7db0c95938" returned: 0 in 0.510s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-c3418d54-6ce3-4b03-9c69-ac7db0c95938" released by "delete_volume" :: held 1.179s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Created reservations ['5ec6e543-9f7f-4e67-8426-73d66160d026', '83e4b5e4-b639-4d9d-a1bf-5b9ec8114a17', '5e8ebd2f-aeca-4131-8d56-67418a7e4150', 'caedaa4e-c364-4a31-a6df-7c6ea602a200'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:29 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:29 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:29 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.522s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:41:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d2d60be4-91bf-4cdd-8637-f3ec172980ca tempest-VolumesGetTest-947807768 None] Lock "cinder-c3418d54-6ce3-4b03-9c69-ac7db0c95938-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (11cf61bf-2004-420f-b809-18e084ac1aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5f82e4-867b-477d-97fe-f296b9a26ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5f82e4-867b-477d-97fe-f296b9a26ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1416142402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da566d32-aeab-4b60-a6d8-35cc378dd11a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:31Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6244d454-3840-4875-a5d5-d7f5ffb62dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6244d454-3840-4875-a5d5-d7f5ffb62dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5048b9f6-69f6-455b-979d-4a4f34370bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:30 devstack cinder-volume[82268]: DEBUG cinder.image.glance [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Creating Keystone auth plugin from conf {{(pid=82268) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5048b9f6-69f6-455b-979d-4a4f34370bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da566d32-aeab-4b60-a6d8-35cc378dd11a', 'volume_name': 'volume-da566d32-aeab-4b60-a6d8-35cc378dd11a', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0a6f640>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed639b9b-68c3-413f-9d63-d21519d06816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed639b9b-68c3-413f-9d63-d21519d06816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c43fdcf-a508-47b8-9a31-5f0a8f2b0a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Volume da566d32-aeab-4b60-a6d8-35cc378dd11a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da566d32-aeab-4b60-a6d8-35cc378dd11a', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0a6f640>}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Trying to clone da566d32-aeab-4b60-a6d8-35cc378dd11a from image 176162cd-bd53-4e34-b5ee-78401d9b8736 at location (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]). {{(pid=82268) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 18:41:31 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d34ff0-7e3b-4519-a92b-c259973671ae]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:31 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD
Apr 20 18:41:31 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:32 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD" returned: 0 in 0.663s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 is fetched for user c1b33e3d4f3f4852abb928ae0feaaa0a. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e53f9-10b4-4358-8db7-173fa067534c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:32 devstack sudo[86876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD
Apr 20 18:41:32 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:32 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1416142402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da566d32-aeab-4b60-a6d8-35cc378dd11a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:31Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Creating volume da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:32 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:32 devstack sudo[86882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a 1073741824
Apr 20 18:41:32 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:33 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a 1073741824" returned: 0 in 0.702s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:33 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:33 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:33 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Attempting download of 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume da566d32-aeab-4b60-a6d8-35cc378dd11a. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[83301d1d-7b76-41c7-926a-595635851761]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:34 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4
Apr 20 18:41:34 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:34 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:34 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4
Apr 20 18:41:34 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:35 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4" returned: 1 in 0.614s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_176162cd-bd53-4e34-b5ee-78401d9b8736_cpma33j4' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ff6b26-3310-4581-a44d-1f58c8ff67fc]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:35 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD
Apr 20 18:41:35 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:35 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] 176162cd-bd53-4e34-b5ee-78401d9b8736 was qcow2, converting to raw {{(pid=82268) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 18:41:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:35 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:35 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:36 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 0 in 1.057s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:36 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_176162cd-bd53-4e34-b5ee-78401d9b8736_oyay5jumdevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:41:36 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Converted 112.00 MB image at 105.86 MB/s
Apr 20 18:41:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:36 devstack sudo[86941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a 1G
Apr 20 18:41:36 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:37 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a 1G" returned: 0 in 0.507s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:37 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e40966-64c1-4867-95bf-2c5cf04962e8]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:37 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:37 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:37 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 0 in 0.576s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:37 devstack sudo[86950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:37 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:38 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 1 in 0.534s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Downloaded image 176162cd-bd53-4e34-b5ee-78401d9b8736 ((None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}])) to volume da566d32-aeab-4b60-a6d8-35cc378dd11a successfully. {{(pid=82268) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Temporary image 176162cd-bd53-4e34-b5ee-78401d9b8736 for user c1b33e3d4f3f4852abb928ae0feaaa0a is deleted. {{(pid=82268) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.volume_utils [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Marking volume da566d32-aeab-4b60-a6d8-35cc378dd11a as bootable. {{(pid=82268) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Copying metadata from image 176162cd-bd53-4e34-b5ee-78401d9b8736 to da566d32-aeab-4b60-a6d8-35cc378dd11a. {{(pid=82268) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Creating volume glance metadata for volume da566d32-aeab-4b60-a6d8-35cc378dd11a backed by image 176162cd-bd53-4e34-b5ee-78401d9b8736 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82268) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c43fdcf-a508-47b8-9a31-5f0a8f2b0a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da566d32-aeab-4b60-a6d8-35cc378dd11a', 'volume_size': 1, 'image_id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/176162cd-bd53-4e34-b5ee-78401d9b8736', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6925aa6d059d458fa69c444c7b2ac3c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '176162cd-bd53-4e34-b5ee-78401d9b8736', 'created_at': datetime.datetime(2026, 4, 20, 16, 33, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 16, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/176162cd-bd53-4e34-b5ee-78401d9b8736/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f36b0a6f640>}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4407911-d59f-4cfa-a8fd-3f4d9227f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:38 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Volume volume-da566d32-aeab-4b60-a6d8-35cc378dd11a (da566d32-aeab-4b60-a6d8-35cc378dd11a): created successfully
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4407911-d59f-4cfa-a8fd-3f4d9227f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (11cf61bf-2004-420f-b809-18e084ac1aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-fa752a1c-2290-49fb-a560-c3a552280b49 tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (d1c92f7e-0268-4aae-905b-cb8c91ba9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278d80cb-f7f1-48b5-9bc6-64d55c428851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278d80cb-f7f1-48b5-9bc6-64d55c428851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1723306757',display_name='tempest-VolumesGetTest-Volume-1531182272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19129783-d84e-40ce-b8a4-b6c67f4d1718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:40Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadbdd8f-fdc0-4a86-8976-9000cf48ff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadbdd8f-fdc0-4a86-8976-9000cf48ff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a38db66-4bee-441d-9773-9cf943f0a098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a38db66-4bee-441d-9773-9cf943f0a098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19129783-d84e-40ce-b8a4-b6c67f4d1718', 'volume_name': 'volume-19129783-d84e-40ce-b8a4-b6c67f4d1718', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ac035d-7bf7-49aa-9232-6e3e67101aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ac035d-7bf7-49aa-9232-6e3e67101aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a4a34a-380a-4539-906d-6904c90d535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:40 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Volume 19129783-d84e-40ce-b8a4-b6c67f4d1718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19129783-d84e-40ce-b8a4-b6c67f4d1718', 'volume_size': 1}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1723306757',display_name='tempest-VolumesGetTest-Volume-1531182272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19129783-d84e-40ce-b8a4-b6c67f4d1718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f4a11684cf48d586d3fe376abd5439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:40Z,use_quota=True,user_id='c1b33e3d4f3f4852abb928ae0feaaa0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Creating volume 19129783-d84e-40ce-b8a4-b6c67f4d1718 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:40 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:40 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 1073741824
Apr 20 18:41:40 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:40 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 1073741824" returned: 0 in 0.638s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:40 devstack sudo[87009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718
Apr 20 18:41:40 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:41 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718" returned: 0 in 0.595s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a4a34a-380a-4539-906d-6904c90d535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19129783-d84e-40ce-b8a4-b6c67f4d1718', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d8d147-3842-4709-a2b7-bafa9be4f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Volume volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 (19129783-d84e-40ce-b8a4-b6c67f4d1718): created successfully
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d8d147-3842-4709-a2b7-bafa9be4f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Flow 'volume_create_manager' (d1c92f7e-0268-4aae-905b-cb8c91ba9e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:41 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c90731bf-5eec-4370-9c53-673768196b34 tempest-VolumesGetTest-947807768 None] Created volume successfully.
Apr 20 18:41:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-19129783-d84e-40ce-b8a4-b6c67f4d1718-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Lock "cinder-19129783-d84e-40ce-b8a4-b6c67f4d1718-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-19129783-d84e-40ce-b8a4-b6c67f4d1718" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-19129783-d84e-40ce-b8a4-b6c67f4d1718" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:42 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[18610e4e-fdff-4bb9-8ce0-5ad968e05531]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:42 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718
Apr 20 18:41:42 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:43 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718" returned: 0 in 0.925s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-21c455df-520e-4d56-a689-4db67b1b9792 tempest-VolumesActionsTest-359768699 None] Acquiring lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" by "attach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:43 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718
Apr 20 18:41:43 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-21c455df-520e-4d56-a689-4db67b1b9792 tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" acquired by "attach_volume" :: waited 0.031s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-21c455df-520e-4d56-a689-4db67b1b9792 tempest-VolumesActionsTest-359768699 None] Attaching volume add0b8d1-5d29-4ef2-9b1d-ce1d9745290b to instance 6fb71dfc-8b00-43a5-a336-e89d601075af at mountpoint /dev/vdb on host None.
Apr 20 18:41:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-21c455df-520e-4d56-a689-4db67b1b9792 tempest-VolumesActionsTest-359768699 None] Attach volume completed successfully.
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-21c455df-520e-4d56-a689-4db67b1b9792 tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" released by "attach_volume" :: held 0.266s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0c5167b-19e3-42c3-a29a-12e00223a5c6 tempest-VolumesActionsTest-359768699 None] Acquiring lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-detach_volume" by "detach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0c5167b-19e3-42c3-a29a-12e00223a5c6 tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a0c5167b-19e3-42c3-a29a-12e00223a5c6 tempest-VolumesActionsTest-359768699 None] Detaching volume add0b8d1-5d29-4ef2-9b1d-ce1d9745290b from instance 6fb71dfc-8b00-43a5-a336-e89d601075af.
Apr 20 18:41:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a0c5167b-19e3-42c3-a29a-12e00223a5c6 tempest-VolumesActionsTest-359768699 None] Detach volume completed successfully.
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0c5167b-19e3-42c3-a29a-12e00223a5c6 tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:43 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-19129783-d84e-40ce-b8a4-b6c67f4d1718" returned: 0 in 0.772s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-19129783-d84e-40ce-b8a4-b6c67f4d1718" released by "delete_volume" :: held 1.779s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Created reservations ['8f801eeb-8c20-4858-8444-fe3b4471d48c', '1a3c4bef-8ce0-490e-ac41-bf4d10f90d8d', 'e5fd4e0a-d233-4dbd-a943-1b568768aa85', 'efc522cd-dc0c-4f3a-9086-ca737bc62f4c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:44 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:44 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-da566d32-aeab-4b60-a6d8-35cc378dd11a-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Lock "cinder-da566d32-aeab-4b60-a6d8-35cc378dd11a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Acquiring lock "cinder-quobyte-da566d32-aeab-4b60-a6d8-35cc378dd11a" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-da566d32-aeab-4b60-a6d8-35cc378dd11a" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f9053-6c21-4040-9b82-96961d92b1fd]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:41:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:44 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:44 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:45 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.881s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:45 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:45 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:41:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-37eae7c8-44eb-4a43-8bfc-1f22a4484b1c tempest-VolumesGetTest-947807768 None] Lock "cinder-19129783-d84e-40ce-b8a4-b6c67f4d1718-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:45 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 0 in 0.677s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:45 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:45 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:46 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 1 in 0.843s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:46 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a
Apr 20 18:41:46 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:46 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-da566d32-aeab-4b60-a6d8-35cc378dd11a" returned: 0 in 0.605s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Lock "cinder-quobyte-da566d32-aeab-4b60-a6d8-35cc378dd11a" released by "delete_volume" :: held 2.227s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Created reservations ['620547a0-9633-42ed-8893-3eca4fa491ac', '52c2d877-6bbb-4027-b467-6cdd023d6f8e', '955807b7-b903-49e7-95a8-815444be4acb', '61b4aab8-4728-42db-80d9-1f5372353d61'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:47 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:41:47 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:47 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.513s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:47 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:41:47 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Deleted volume successfully.
Apr 20 18:41:47 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-08c486ef-fdcd-419b-8665-afd9f97d4e29 tempest-VolumesGetTest-947807768 None] Lock "cinder-da566d32-aeab-4b60-a6d8-35cc378dd11a-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=145,cinder:DELETE=8,cinder:SELECT=131,cinder:INSERT=42 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=109,cinder:INSERT=48,cinder:UPDATE=161,cinder:DELETE=15 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (8c570af5-7731-435f-8c37-8e6360baa826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16362f51-8be1-4c5d-b8b8-5ca501f01a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16362f51-8be1-4c5d-b8b8-5ca501f01a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064232115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750a8ad9-50f4-4212-97cb-ab7399b29091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:57Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dedaa5-2ae3-4f80-b14d-b704de1d09fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dedaa5-2ae3-4f80-b14d-b704de1d09fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb7275f-0445-42fa-8ab5-33847e775914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb7275f-0445-42fa-8ab5-33847e775914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750a8ad9-50f4-4212-97cb-ab7399b29091', 'volume_name': 'volume-750a8ad9-50f4-4212-97cb-ab7399b29091', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6245fb6f-9111-4495-b8b0-36b14c7e18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6245fb6f-9111-4495-b8b0-36b14c7e18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cacebf-1df6-4495-a029-4fd53bedb153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:57 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Volume 750a8ad9-50f4-4212-97cb-ab7399b29091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750a8ad9-50f4-4212-97cb-ab7399b29091', 'volume_size': 1}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2064232115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750a8ad9-50f4-4212-97cb-ab7399b29091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:57Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Creating volume 750a8ad9-50f4-4212-97cb-ab7399b29091 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:57 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:57 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091 1073741824
Apr 20 18:41:57 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (875e1abf-d327-4af8-8a3c-61c8fb94535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167a9d25-5e96-494e-ab43-8d5bd005b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:58 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091 1073741824" returned: 0 in 0.696s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167a9d25-5e96-494e-ab43-8d5bd005b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-361239266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd857e0-a684-4d8a-9348-171b714dcd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:58Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849cd850-fde8-47a3-b339-1a4a3ee4e89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849cd850-fde8-47a3-b339-1a4a3ee4e89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3295d53b-ec31-471a-984e-9f4fb747cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3295d53b-ec31-471a-984e-9f4fb747cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd857e0-a684-4d8a-9348-171b714dcd5a', 'volume_name': 'volume-6fd857e0-a684-4d8a-9348-171b714dcd5a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fc165c-bc1c-4474-b292-c23adc37aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fc165c-bc1c-4474-b292-c23adc37aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2e98aa-907b-477a-afce-f52acc205b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:58 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume 6fd857e0-a684-4d8a-9348-171b714dcd5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd857e0-a684-4d8a-9348-171b714dcd5a', 'volume_size': 1}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:58 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091
Apr 20 18:41:58 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:59 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091" returned: 0 in 0.675s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-361239266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd857e0-a684-4d8a-9348-171b714dcd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:41:58Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating volume 6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:41:59 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cacebf-1df6-4495-a029-4fd53bedb153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750a8ad9-50f4-4212-97cb-ab7399b29091', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55106cf2-f065-4401-9c04-de27b9aec91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:41:59 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Volume volume-750a8ad9-50f4-4212-97cb-ab7399b29091 (750a8ad9-50f4-4212-97cb-ab7399b29091): created successfully
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55106cf2-f065-4401-9c04-de27b9aec91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (8c570af5-7731-435f-8c37-8e6360baa826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:41:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-1b2aad87-be3d-4434-a252-cee07335139b tempest-VolumesActionsTest-317159510 None] Created volume successfully.
Apr 20 18:41:59 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a 1073741824
Apr 20 18:41:59 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-940962cd-00c3-4b81-a2ba-fbd3f8d932c7 tempest-VolumesActionsTest-317159510 None] Acquiring lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091" by "attach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-940962cd-00c3-4b81-a2ba-fbd3f8d932c7 tempest-VolumesActionsTest-317159510 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091" acquired by "attach_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:41:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-940962cd-00c3-4b81-a2ba-fbd3f8d932c7 tempest-VolumesActionsTest-317159510 None] Attaching volume 750a8ad9-50f4-4212-97cb-ab7399b29091 to instance 34bb54f1-e9a3-45ff-91ba-4ebbbe29cf00 at mountpoint /dev/vdb on host None.
Apr 20 18:41:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-940962cd-00c3-4b81-a2ba-fbd3f8d932c7 tempest-VolumesActionsTest-317159510 None] Attach volume completed successfully.
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-940962cd-00c3-4b81-a2ba-fbd3f8d932c7 tempest-VolumesActionsTest-317159510 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091" released by "attach_volume" :: held 0.096s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:41:59 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a 1073741824" returned: 0 in 0.708s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:41:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:41:59 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a
Apr 20 18:41:59 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:00 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a" returned: 0 in 0.809s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2e98aa-907b-477a-afce-f52acc205b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd857e0-a684-4d8a-9348-171b714dcd5a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e4b958-749d-42b9-b342-39baac23cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:00 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume volume-6fd857e0-a684-4d8a-9348-171b714dcd5a (6fd857e0-a684-4d8a-9348-171b714dcd5a): created successfully
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e4b958-749d-42b9-b342-39baac23cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (875e1abf-d327-4af8-8a3c-61c8fb94535b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f9f65977-0a9c-42f7-9740-b51be647b205 tempest-VolumesSnapshotTestJSON-2046501300 None] Created volume successfully.
Apr 20 18:42:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3935ae08-c5e8-469b-aa46-846a59673184 tempest-VolumesActionsTest-1032879731 None] Terminate volume connection completed successfully.
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3935ae08-c5e8-469b-aa46-846a59673184 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-detach_volume" by "detach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3935ae08-c5e8-469b-aa46-846a59673184 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3935ae08-c5e8-469b-aa46-846a59673184 tempest-VolumesActionsTest-1032879731 None] Detaching volume 750a8ad9-50f4-4212-97cb-ab7399b29091 from instance 34bb54f1-e9a3-45ff-91ba-4ebbbe29cf00.
Apr 20 18:42:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3935ae08-c5e8-469b-aa46-846a59673184 tempest-VolumesActionsTest-1032879731 None] Detach volume completed successfully.
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3935ae08-c5e8-469b-aa46-846a59673184 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating offline snapshot 97fbc4c3-32dd-4163-9ade-648fb702e482 of volume 6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc31d9-0ec6-417e-b9e4-5cb98387481c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:01 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a
Apr 20 18:42:01 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cf912164-2bdc-4b31-9aa6-689e4eb843cc tempest-VolumesActionsTest-317159510 None] Acquiring lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-detach_volume" by "detach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cf912164-2bdc-4b31-9aa6-689e4eb843cc tempest-VolumesActionsTest-317159510 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cf912164-2bdc-4b31-9aa6-689e4eb843cc tempest-VolumesActionsTest-317159510 None] Volume detach called, but volume not attached.
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cf912164-2bdc-4b31-9aa6-689e4eb843cc tempest-VolumesActionsTest-317159510 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:02 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a" returned: 0 in 0.568s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:02 devstack sudo[87242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 1G
Apr 20 18:42:02 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:02 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:02 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Acquiring lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Acquiring lock "cinder-quobyte-750a8ad9-50f4-4212-97cb-ab7399b29091" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Lock "cinder-quobyte-750a8ad9-50f4-4212-97cb-ab7399b29091" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc26aff0-6d72-4540-8c7a-5594b8a8d70c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:02 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091
Apr 20 18:42:02 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:02 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 1G" returned: 0 in 0.583s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fd857e0-a684-4d8a-9348-171b714dcd5a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:02 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fd857e0-a684-4d8a-9348-171b714dcd5a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482
Apr 20 18:42:02 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:02 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.495s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:03 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fd857e0-a684-4d8a-9348-171b714dcd5a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482" returned: 0 in 0.510s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:03 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 is being set with open permissions: ugo+rw
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:03 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091" returned: 0 in 0.634s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:03 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482
Apr 20 18:42:03 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:03 devstack sudo[87261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091
Apr 20 18:42:03 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:03 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-750a8ad9-50f4-4212-97cb-ab7399b29091" returned: 0 in 0.461s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Lock "cinder-quobyte-750a8ad9-50f4-4212-97cb-ab7399b29091" released by "delete_volume" :: held 1.134s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Created reservations ['19effed5-2dc7-4a94-b5ac-646b646e9e0d', '53570241-c5ba-47ae-a48b-011276ad0510', '3978d5a9-e0a3-4894-b249-5c6b936a0b23', '7ec9ec4e-618a-404b-973f-cc2a37a508a0'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:03 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482" returned: 0 in 0.536s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:03 devstack sudo[87266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info
Apr 20 18:42:03 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:03 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:03 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:04 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.704s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:04 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:04 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Deleted volume successfully.
Apr 20 18:42:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0296844-5f55-4eb9-8cc5-e54a844790f1 tempest-VolumesActionsTest-317159510 None] Lock "cinder-750a8ad9-50f4-4212-97cb-ab7399b29091-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:04 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info" returned: 0 in 0.811s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:04 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info is being set with open permissions: ugo+rw
Apr 20 18:42:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:04 devstack sudo[87282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info
Apr 20 18:42:04 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:05 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.info" returned: 0 in 0.730s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.812s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-588cc092-85e3-48c2-a9b4-bebeef8f61b6 tempest-VolumesSnapshotTestJSON-2046501300 None] Create snapshot completed successfully
Apr 20 18:42:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-97fbc4c3-32dd-4163-9ade-648fb702e482-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-97fbc4c3-32dd-4163-9ade-648fb702e482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-6fd857e0-a684-4d8a-9348-171b714dcd5a" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-6fd857e0-a684-4d8a-9348-171b714dcd5a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-97fbc4c3-32dd-4163-9ade-648fb702e482" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-97fbc4c3-32dd-4163-9ade-648fb702e482" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Deleting offline snapshot 97fbc4c3-32dd-4163-9ade-648fb702e482 of volume 6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] snapshot_file for this snap is: volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[afacb264-da84-47cd-9e47-1950b1b0c720]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:06 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482
Apr 20 18:42:06 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:06 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482" returned: 0 in 0.599s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fd857e0-a684-4d8a-9348-171b714dcd5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c795e4-e04e-40f6-8f2a-a4eaa7b817f3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:06 devstack sudo[87344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a
Apr 20 18:42:06 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:07 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a" returned: 0 in 0.643s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:07 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482
Apr 20 18:42:07 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:08 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482" returned: 0 in 0.997s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:08 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482
Apr 20 18:42:08 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:08 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a.97fbc4c3-32dd-4163-9ade-648fb702e482" returned: 0 in 0.536s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-97fbc4c3-32dd-4163-9ade-648fb702e482" released by "_delete_snapshot" :: held 2.835s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-6fd857e0-a684-4d8a-9348-171b714dcd5a" released by "delete_snapshot" :: held 2.846s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['9c88485a-c799-4040-80f9-f8f29cf0798b', 'b74c1a03-0a3c-4855-89b2-b0cac668578d', 'c056d33b-263f-4e46-bf71-d92a49b32dfa', '9f912cd6-6cbc-41ce-aa93-47d9b8bff32b'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Delete snapshot completed successfully.
Apr 20 18:42:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f90ec523-a458-497a-8d3c-b9e355904370 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-97fbc4c3-32dd-4163-9ade-648fb702e482-delete_snapshot" released by "delete_snapshot" :: held 3.002s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (c24627c2-7dec-41e7-b1fc-6e2ab187918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853f2778-2bc1-447b-b2a6-9dab484d0b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853f2778-2bc1-447b-b2a6-9dab484d0b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493531140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcb4bf8-41c3-4375-801d-398be22bfcc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:09Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed75fd8c-4c21-4b07-9b36-15ea5ec07e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed75fd8c-4c21-4b07-9b36-15ea5ec07e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2831110b-cb0c-447f-91da-f116c30cc8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2831110b-cb0c-447f-91da-f116c30cc8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcb4bf8-41c3-4375-801d-398be22bfcc4', 'volume_name': 'volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d561f793-065a-4479-84a6-b6ad64d31cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d561f793-065a-4479-84a6-b6ad64d31cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110d8e20-b46c-4770-bbff-c5fa5001b650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:09 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume 4dcb4bf8-41c3-4375-801d-398be22bfcc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4', 'volume_size': 1}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1493531140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcb4bf8-41c3-4375-801d-398be22bfcc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:09Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating volume 4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:09 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:09 devstack sudo[87379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 1073741824
Apr 20 18:42:09 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:10 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 1073741824" returned: 0 in 0.846s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:10 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:10 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:11 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 0.874s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110d8e20-b46c-4770-bbff-c5fa5001b650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16f5423-c230-4652-ade9-18a42724f144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:11 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 (4dcb4bf8-41c3-4375-801d-398be22bfcc4): created successfully
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16f5423-c230-4652-ade9-18a42724f144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (c24627c2-7dec-41e7-b1fc-6e2ab187918c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5f90dcb8-e0c5-4c0b-873d-ff164f748ce4 tempest-VolumesSnapshotTestJSON-2046501300 None] Created volume successfully.
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating offline snapshot 49281706-c868-4e67-a4e9-9ab3ac0e12cc of volume 4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb35e4d-de01-46a2-b20c-0ef83e94dbc7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:12 devstack sudo[87419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:12 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (f34f66af-0926-4a68-a91f-b0cf1c79bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817e8deb-eb48-498e-8d80-980f5b2aa66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (817e8deb-eb48-498e-8d80-980f5b2aa66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1880276774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855b3158-4eff-4394-8a83-d176aff6f9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:12Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df918f8-38ea-454b-9ac6-6f3bc96b1813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df918f8-38ea-454b-9ac6-6f3bc96b1813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0ba116-b0d3-4be0-909e-595e70555859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0ba116-b0d3-4be0-909e-595e70555859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855b3158-4eff-4394-8a83-d176aff6f9cd', 'volume_name': 'volume-855b3158-4eff-4394-8a83-d176aff6f9cd', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec98fd6f-db44-4525-9d9f-88e5f755fb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec98fd6f-db44-4525-9d9f-88e5f755fb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe371afd-6041-41a1-83a2-86aca662393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:12 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Volume 855b3158-4eff-4394-8a83-d176aff6f9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855b3158-4eff-4394-8a83-d176aff6f9cd', 'volume_size': 1}
Apr 20 18:42:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-24a789bd-501a-49f8-802a-c54567c7303b tempest-VolumesActionsTest-359768699 None] Acquiring lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" by "attach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-24a789bd-501a-49f8-802a-c54567c7303b tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" acquired by "attach_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-24a789bd-501a-49f8-802a-c54567c7303b tempest-VolumesActionsTest-359768699 None] Attaching volume add0b8d1-5d29-4ef2-9b1d-ce1d9745290b to instance 189720f0-29c9-4417-8322-0a83af7a3273 at mountpoint /dev/vdb on host None.
Apr 20 18:42:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-24a789bd-501a-49f8-802a-c54567c7303b tempest-VolumesActionsTest-359768699 None] Attach volume completed successfully.
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-24a789bd-501a-49f8-802a-c54567c7303b tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" released by "attach_volume" :: held 0.099s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:13 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 1.174s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:13 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc 1G
Apr 20 18:42:13 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a3e9599d-2791-4932-aaa0-d9dcc8f4a707 tempest-VolumesActionsTest-359768699 None] Acquiring lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-detach_volume" by "detach_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a3e9599d-2791-4932-aaa0-d9dcc8f4a707 tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a3e9599d-2791-4932-aaa0-d9dcc8f4a707 tempest-VolumesActionsTest-359768699 None] Detaching volume add0b8d1-5d29-4ef2-9b1d-ce1d9745290b from instance 189720f0-29c9-4417-8322-0a83af7a3273.
Apr 20 18:42:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a3e9599d-2791-4932-aaa0-d9dcc8f4a707 tempest-VolumesActionsTest-359768699 None] Detach volume completed successfully.
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a3e9599d-2791-4932-aaa0-d9dcc8f4a707 tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:13 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc 1G" returned: 0 in 0.772s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:13 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc
Apr 20 18:42:13 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:14 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc" returned: 0 in 0.762s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:14 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc is being set with open permissions: ugo+rw
Apr 20 18:42:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:14 devstack sudo[87462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc
Apr 20 18:42:14 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:15 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc" returned: 0 in 0.537s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:15 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info
Apr 20 18:42:15 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:15 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info" returned: 0 in 0.646s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:15 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info is being set with open permissions: ugo+rw
Apr 20 18:42:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:15 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info
Apr 20 18:42:15 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:16 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.info" returned: 0 in 0.680s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.670s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.992s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1880276774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855b3158-4eff-4394-8a83-d176aff6f9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:12Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Creating volume 855b3158-4eff-4394-8a83-d176aff6f9cd {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:16 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7a6df077-cb42-4013-8da2-7226fe5f5b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Create snapshot completed successfully
Apr 20 18:42:16 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd 1073741824
Apr 20 18:42:16 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (94515342-8c58-4eae-8751-ba272e3b7a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f914780f-c95e-46a4-9c59-fdee15e6bdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:17 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f914780f-c95e-46a4-9c59-fdee15e6bdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783843837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29486d3-1da5-4382-83a2-1c15bc4b039d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=49281706-c868-4e67-a4e9-9ab3ac0e12cc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:18Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaa3246-5750-4359-b90b-95a9baf8ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaa3246-5750-4359-b90b-95a9baf8ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc0b36b-8812-44a0-aca0-a50710313ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc0b36b-8812-44a0-aca0-a50710313ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b29486d3-1da5-4382-83a2-1c15bc4b039d', 'volume_name': 'volume-b29486d3-1da5-4382-83a2-1c15bc4b039d', 'volume_size': 2, 'snapshot_id': '49281706-c868-4e67-a4e9-9ab3ac0e12cc'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14448ca-8e66-4753-b8e4-8f89db12ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14448ca-8e66-4753-b8e4-8f89db12ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8235bf83-5b82-4dcc-80fa-8c07b75bd3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:17 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume b29486d3-1da5-4382-83a2-1c15bc4b039d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b29486d3-1da5-4382-83a2-1c15bc4b039d', 'volume_size': 2, 'snapshot_id': '49281706-c868-4e67-a4e9-9ab3ac0e12cc'}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd 1073741824" returned: 0 in 1.054s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:17 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd
Apr 20 18:42:17 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:18 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd" returned: 0 in 0.449s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.475s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-49281706-c868-4e67-a4e9-9ab3ac0e12cc-b29486d3-1da5-4382-83a2-1c15bc4b039d" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe371afd-6041-41a1-83a2-86aca662393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855b3158-4eff-4394-8a83-d176aff6f9cd', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a0d0a3-7083-4add-a436-15f4af607b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:18 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Volume volume-855b3158-4eff-4394-8a83-d176aff6f9cd (855b3158-4eff-4394-8a83-d176aff6f9cd): created successfully
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a0d0a3-7083-4add-a436-15f4af607b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (f34f66af-0926-4a68-a91f-b0cf1c79bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:18 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3b1a38c2-8fbf-4924-9199-984c04493681 tempest-VolumesActionsTest-317159510 None] Created volume successfully.
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-49281706-c868-4e67-a4e9-9ab3ac0e12cc-b29486d3-1da5-4382-83a2-1c15bc4b039d" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating volume b29486d3-1da5-4382-83a2-1c15bc4b039d from snapshot 49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-b29486d3-1da5-4382-83a2-1c15bc4b039d" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-b29486d3-1da5-4382-83a2-1c15bc4b039d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] snapshot: 49281706-c868-4e67-a4e9-9ab3ac0e12cc, volume: b29486d3-1da5-4382-83a2-1c15bc4b039d,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d743918-d515-4f1f-b1a1-e6452ac795b5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:18 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc
Apr 20 18:42:18 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:18 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc" returned: 0 in 0.517s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[63566a83-28c5-45ab-be65-15b2c8437816]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:18 devstack sudo[87570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:18 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-855b3158-4eff-4394-8a83-d176aff6f9cd-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-855b3158-4eff-4394-8a83-d176aff6f9cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-quobyte-855b3158-4eff-4394-8a83-d176aff6f9cd" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-855b3158-4eff-4394-8a83-d176aff6f9cd" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37c4ea-5504-4515-8963-7cec28da78f3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:19 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd
Apr 20 18:42:19 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:19 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 0.565s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:19 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d
Apr 20 18:42:19 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:19 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd" returned: 0 in 0.743s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:19 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd
Apr 20 18:42:19 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:21 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-855b3158-4eff-4394-8a83-d176aff6f9cd" returned: 0 in 1.716s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-855b3158-4eff-4394-8a83-d176aff6f9cd" released by "delete_volume" :: held 2.503s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:21 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Created reservations ['ffbfe6bb-58c0-4e80-96ab-e036b6bd2ba9', 'e0d7a4c8-2a86-4f2d-abb6-55fc932b6641', 'd97ceda4-15ee-424e-8333-444d278ea0c4', 'e74a9a30-6983-4e8f-b2d0-6a2251d61e2b'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:22 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:22 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:23 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d" returned: 0 in 4.228s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1390d95-01da-4031-a23a-8c48072d3e4e]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:23 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:23 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:23 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.630s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Flow 'volume_create_manager' (1eeba0ee-a756-4a61-a649-f57895f47d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4a8d91-cfe5-4b08-afa0-8aa19c66c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:23 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Deleted volume successfully.
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4a8d91-cfe5-4b08-afa0-8aa19c66c01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-697852420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0c4a77-74a1-4605-82bb-3fccc514dc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fe77e1bf754aa3a7fc95f5b57c3240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:24Z,use_quota=True,user_id='b89986b6929944f48fa114c1bcefaf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcdf511-bbba-4a0c-8114-ff73fdcfafb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcdf511-bbba-4a0c-8114-ff73fdcfafb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31b593b-ab35-428b-9f54-30854762c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31b593b-ab35-428b-9f54-30854762c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0c4a77-74a1-4605-82bb-3fccc514dc1f', 'volume_name': 'volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480708bf-33bf-47d2-80c3-93f15715c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480708bf-33bf-47d2-80c3-93f15715c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51101d4-2ab4-4033-8f16-404a31410fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Volume 4b0c4a77-74a1-4605-82bb-3fccc514dc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f', 'volume_size': 1}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (ee65ad1e-8dbc-40b1-a6e1-f506dc1e3025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c27c4fd-367e-4198-87ce-729cb7b91cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c27c4fd-367e-4198-87ce-729cb7b91cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-565941830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaabbe5-c183-46ec-9ccc-54c2c176f83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:24Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47388f5f-7c40-4d0f-9f49-7df9386d4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47388f5f-7c40-4d0f-9f49-7df9386d4191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ccf82-b91f-4773-993a-dd6a2c2c5a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ccf82-b91f-4773-993a-dd6a2c2c5a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaaabbe5-c183-46ec-9ccc-54c2c176f83e', 'volume_name': 'volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dacb770-620a-49a7-bbb0-67629dfe4600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dacb770-620a-49a7-bbb0-67629dfe4600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a275de-194c-4032-b112-1e3b4e0087e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:24 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Volume aaaabbe5-c183-46ec-9ccc-54c2c176f83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e', 'volume_size': 1}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b44a56a4-3370-4e40-82f9-c611fcdf8ca6 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-855b3158-4eff-4394-8a83-d176aff6f9cd-delete_volume" released by "delete_volume" :: held 4.997s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:24 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 0.842s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:42:24 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Converted 1024.00 MB image at 242.13 MB/s
Apr 20 18:42:24 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d is being set with open permissions: ugo+rw
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:24 devstack sudo[87635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d
Apr 20 18:42:24 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:24 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d" returned: 0 in 0.543s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-b29486d3-1da5-4382-83a2-1c15bc4b039d" released by "_copy_volume_from_snapshot" :: held 6.759s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-49281706-c868-4e67-a4e9-9ab3ac0e12cc-b29486d3-1da5-4382-83a2-1c15bc4b039d" released by "_create_volume_from_snapshot" :: held 6.776s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.813s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-697852420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0c4a77-74a1-4605-82bb-3fccc514dc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fe77e1bf754aa3a7fc95f5b57c3240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:24Z,use_quota=True,user_id='b89986b6929944f48fa114c1bcefaf8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Creating volume 4b0c4a77-74a1-4605-82bb-3fccc514dc1f {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:24 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8235bf83-5b82-4dcc-80fa-8c07b75bd3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29486d3-1da5-4382-83a2-1c15bc4b039d', 'volume_size': 2, 'snapshot_id': '49281706-c868-4e67-a4e9-9ab3ac0e12cc'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6ef7e0-e0b9-40eb-81d6-836626043bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:25 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f 1073741824
Apr 20 18:42:25 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:25 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume volume-b29486d3-1da5-4382-83a2-1c15bc4b039d (b29486d3-1da5-4382-83a2-1c15bc4b039d): created successfully
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6ef7e0-e0b9-40eb-81d6-836626043bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (94515342-8c58-4eae-8751-ba272e3b7a10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-69331426-60c6-402a-8cdc-526204c24bc6 tempest-VolumesSnapshotTestJSON-2046501300 None] Created volume successfully.
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:25 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f 1073741824" returned: 0 in 0.560s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:25 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f
Apr 20 18:42:25 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-b29486d3-1da5-4382-83a2-1c15bc4b039d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-b29486d3-1da5-4382-83a2-1c15bc4b039d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-b29486d3-1da5-4382-83a2-1c15bc4b039d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-b29486d3-1da5-4382-83a2-1c15bc4b039d" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e6c03-6ecb-4730-99a5-804a975121a0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:26 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d
Apr 20 18:42:26 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:26 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f" returned: 0 in 0.527s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-565941830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaabbe5-c183-46ec-9ccc-54c2c176f83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:24Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Creating volume aaaabbe5-c183-46ec-9ccc-54c2c176f83e {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:26 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51101d4-2ab4-4033-8f16-404a31410fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164e34ce-d00e-4d8f-8732-472c42439b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:26 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Volume volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f (4b0c4a77-74a1-4605-82bb-3fccc514dc1f): created successfully
Apr 20 18:42:26 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e 1073741824
Apr 20 18:42:26 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164e34ce-d00e-4d8f-8732-472c42439b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Flow 'volume_create_manager' (1eeba0ee-a756-4a61-a649-f57895f47d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:26 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-304ccd78-b2b2-4330-a42f-1e63c7e527cf tempest-ServerRescueNegativeTestJSON-1496715678 None] Created volume successfully.
Apr 20 18:42:26 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d" returned: 0 in 0.501s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:26 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d
Apr 20 18:42:26 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:26 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e 1073741824" returned: 0 in 0.546s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:26 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e
Apr 20 18:42:26 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:26 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b29486d3-1da5-4382-83a2-1c15bc4b039d" returned: 0 in 0.429s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-b29486d3-1da5-4382-83a2-1c15bc4b039d" released by "delete_volume" :: held 0.950s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['ddccf0fc-2139-4c17-92f4-8011e949aabc', 'b7e1f15e-e80b-413a-b35f-d3cae9ddcc1a', 'db011128-a38d-4054-968f-e767b5f6d4a7', '3e0dfe1b-0edc-4ccf-a979-5720485b39bb'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:27 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:27 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-49281706-c868-4e67-a4e9-9ab3ac0e12cc-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-49281706-c868-4e67-a4e9-9ab3ac0e12cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-4dcb4bf8-41c3-4375-801d-398be22bfcc4" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-4dcb4bf8-41c3-4375-801d-398be22bfcc4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-49281706-c868-4e67-a4e9-9ab3ac0e12cc" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-49281706-c868-4e67-a4e9-9ab3ac0e12cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Deleting offline snapshot 49281706-c868-4e67-a4e9-9ab3ac0e12cc of volume 4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] snapshot_file for this snap is: volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39fdf7a-7eea-4b15-9c58-8e8e07d299d0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:27 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e" returned: 0 in 0.704s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.248s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a275de-194c-4032-b112-1e3b4e0087e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:27 devstack sudo[87665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc
Apr 20 18:42:27 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a6ed48-63d6-487b-8a92-abda1409bcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57541da-2e62-4fd8-8fe5-c38b39bb1b7d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:27 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Volume volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e (aaaabbe5-c183-46ec-9ccc-54c2c176f83e): created successfully
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a6ed48-63d6-487b-8a92-abda1409bcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (ee65ad1e-8dbc-40b1-a6e1-f506dc1e3025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-44e114fa-6dbc-46af-bef6-18f3e6e53b80 tempest-VolumesActionsTest-317159510 None] Created volume successfully.
Apr 20 18:42:27 devstack sudo[87668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:27 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:27 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc" returned: 0 in 0.711s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9d922f-283b-4072-914d-75c338a33d01]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:27 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.957s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Deleted volume successfully.
Apr 20 18:42:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c05ba614-5280-4103-a2b3-7b9bb3b1a386 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-b29486d3-1da5-4382-83a2-1c15bc4b039d-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:28 devstack sudo[87674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:28 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-aaaabbe5-c183-46ec-9ccc-54c2c176f83e-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-aaaabbe5-c183-46ec-9ccc-54c2c176f83e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-quobyte-aaaabbe5-c183-46ec-9ccc-54c2c176f83e" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-aaaabbe5-c183-46ec-9ccc-54c2c176f83e" acquired by "delete_volume" :: waited 0.026s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3945dded-88b5-4958-8092-d50e768898ba]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:28 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 1.094s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d089df1-386a-43a4-8de3-87660b1f6842]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:28 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e
Apr 20 18:42:28 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:28 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:28 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:28 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 0.995s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:28 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc
Apr 20 18:42:28 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:29 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.776s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.e9690511-6c03-4634-8775-eb23830ddabb6fwjvz7z.img {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:29 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.e9690511-6c03-4634-8775-eb23830ddabb6fwjvz7z.img
Apr 20 18:42:29 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:29 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e" returned: 0 in 0.950s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:29 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e
Apr 20 18:42:29 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:29 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc" returned: 0 in 0.824s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:29 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc
Apr 20 18:42:29 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:29 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-aaaabbe5-c183-46ec-9ccc-54c2c176f83e" returned: 0 in 0.577s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-aaaabbe5-c183-46ec-9ccc-54c2c176f83e" released by "delete_volume" :: held 1.556s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Created reservations ['6be24518-84f9-4797-862d-2ce62f4e1271', '7918e8f6-fa9c-4d64-a602-be4319a3dbb4', '788f3b75-4d97-452f-9357-dc333511b3e5', '816378f3-82a4-4e79-bfb6-59e398d5f895'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:30 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:30 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:31 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.664s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:31 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Deleted volume successfully.
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f25b9a5d-d16f-4273-8662-32ab029d7da3 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-aaaabbe5-c183-46ec-9ccc-54c2c176f83e-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:32 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4.49281706-c868-4e67-a4e9-9ab3ac0e12cc" returned: 0 in 2.808s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-49281706-c868-4e67-a4e9-9ab3ac0e12cc" released by "_delete_snapshot" :: held 5.422s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-4dcb4bf8-41c3-4375-801d-398be22bfcc4" released by "delete_snapshot" :: held 5.456s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['894a904e-3251-490a-866e-9769ea06619c', '8e3a10cc-973c-45ab-99b6-baecaa28d1c4', 'ee1af47f-343a-493d-8253-fc342ec6fade', '0810af52-b0df-43f7-952c-a2d07e0ca420'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Delete snapshot completed successfully.
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f2ca622c-d0e3-49d1-b4b3-54ef6ae4ba95 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-49281706-c868-4e67-a4e9-9ab3ac0e12cc-delete_snapshot" released by "delete_snapshot" :: held 5.652s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (3bee2fda-fa8b-4fb6-97cc-f82df5a3c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:32 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca420b1-75dd-46f3-be38-f00bce2e50d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.e9690511-6c03-4634-8775-eb23830ddabb6fwjvz7z.img" returned: 0 in 3.597s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[16944089-ebee-4a3e-979a-0cd529aac771]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca420b1-75dd-46f3-be38-f00bce2e50d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-200854494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5229549-5fc0-47c4-9326-b641a2ec727e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:33Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544c9f59-583e-41a5-8daa-ce3d1a36ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544c9f59-583e-41a5-8daa-ce3d1a36ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7d30ef-0445-41b2-b8aa-8df84b4fb85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7d30ef-0445-41b2-b8aa-8df84b4fb85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5229549-5fc0-47c4-9326-b641a2ec727e', 'volume_name': 'volume-b5229549-5fc0-47c4-9326-b641a2ec727e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c27e5a-7011-4672-adbc-9fe7fda6871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c27e5a-7011-4672-adbc-9fe7fda6871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968892a2-c515-4526-a43f-7b51a5bee44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:32 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Volume b5229549-5fc0-47c4-9326-b641a2ec727e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5229549-5fc0-47c4-9326-b641a2ec727e', 'volume_size': 1}
Apr 20 18:42:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:32 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:32 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:33 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.607s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b, size 1024.00 MB, duration 3.60 sec, destination /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.e9690511-6c03-4634-8775-eb23830ddabb6fwjvz7z.img {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:42:33 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Converted 1024.00 MB image at 284.37 MB/s
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] e9690511-6c03-4634-8775-eb23830ddabb was raw, no need to convert to raw {{(pid=82268) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-4dcb4bf8-41c3-4375-801d-398be22bfcc4-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-4dcb4bf8-41c3-4375-801d-398be22bfcc4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-4dcb4bf8-41c3-4375-801d-398be22bfcc4" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-4dcb4bf8-41c3-4375-801d-398be22bfcc4" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2274209-68e6-409b-9fa7-1e74fc5e05a5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:33 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:33 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:34 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 0.540s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:34 devstack sudo[87773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4
Apr 20 18:42:34 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:34 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4dcb4bf8-41c3-4375-801d-398be22bfcc4" returned: 0 in 0.537s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-4dcb4bf8-41c3-4375-801d-398be22bfcc4" released by "delete_volume" :: held 1.133s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['6aefff2d-6a48-4cba-9780-c801318abc26', '0d3553a8-2ca9-4e3f-b215-a5b96060c5d1', '3a0420b4-4aed-43fd-9a55-0f6eebc531a3', 'd4b30659-abde-47bc-a845-ed1bdee89989'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:35 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:35 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:35 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.510s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:35 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Deleted volume successfully.
Apr 20 18:42:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-900faae5-0573-48d1-9f77-c3cdef49461a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-4dcb4bf8-41c3-4375-801d-398be22bfcc4-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (c05cac1a-b6b8-4277-9260-84f5566255d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6dfe0b-ef64-49d3-8d2d-4d058056f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6dfe0b-ef64-49d3-8d2d-4d058056f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1373229989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:37Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccef1634-2ca2-4457-9250-1cefeb2351b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccef1634-2ca2-4457-9250-1cefeb2351b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3cfc870-78aa-4db2-b5e6-000501a959d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3cfc870-78aa-4db2-b5e6-000501a959d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d', 'volume_name': 'volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f26d49e-ce32-42f6-93d5-37a803b4924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f26d49e-ce32-42f6-93d5-37a803b4924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daf53be-0bc0-43b0-98ac-100001b0f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:36 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume 42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d', 'volume_size': 1}
Apr 20 18:42:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Acquiring lock "cinder-4b0c4a77-74a1-4605-82bb-3fccc514dc1f-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "cinder-4b0c4a77-74a1-4605-82bb-3fccc514dc1f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Acquiring lock "cinder-quobyte-4b0c4a77-74a1-4605-82bb-3fccc514dc1f" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "cinder-quobyte-4b0c4a77-74a1-4605-82bb-3fccc514dc1f" acquired by "delete_volume" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:44 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c80aaa-d3fd-4abe-bed0-7b170d690aad]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:44 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f
Apr 20 18:42:44 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:45 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f" returned: 0 in 0.789s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:45 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f
Apr 20 18:42:45 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:45 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.265s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Uploaded volume to glance image-id: e9690511-6c03-4634-8775-eb23830ddabb. {{(pid=82268) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.694s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-200854494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5229549-5fc0-47c4-9326-b641a2ec727e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:33Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Creating volume b5229549-5fc0-47c4-9326-b641a2ec727e {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:45 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-4b0c4a77-74a1-4605-82bb-3fccc514dc1f" returned: 0 in 0.603s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:45 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e 1073741824
Apr 20 18:42:45 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "cinder-quobyte-4b0c4a77-74a1-4605-82bb-3fccc514dc1f" released by "delete_volume" :: held 1.471s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:45 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c9bec957-11c0-4498-8085-7018ff0b1360 tempest-VolumesActionsTest-359768699 None] Copy volume to image completed successfully.
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Created reservations ['5f2ac068-fda7-4a23-abba-915b2ef10652', 'f95072f8-65d4-49a8-a3f5-861b2f49d279', '2d6345c3-a92b-432a-a97d-9338577edb3a', 'bd060d71-8231-42cc-8b01-fe6813407bd1'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:45 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:45 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:46 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.459s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:46 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:46 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Deleted volume successfully.
Apr 20 18:42:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1d19d255-effe-4336-97ca-49247c2d949e tempest-ServerRescueNegativeTestJSON-1496715678 None] Lock "cinder-4b0c4a77-74a1-4605-82bb-3fccc514dc1f-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:46 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e 1073741824" returned: 0 in 0.785s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:46 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e
Apr 20 18:42:46 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:47 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e" returned: 0 in 0.676s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.180s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1373229989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:37Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating volume 42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:47 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968892a2-c515-4526-a43f-7b51a5bee44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5229549-5fc0-47c4-9326-b641a2ec727e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:47 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d 1073741824
Apr 20 18:42:47 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157cc37f-6442-4eed-a21c-455176b6d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:47 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Volume volume-b5229549-5fc0-47c4-9326-b641a2ec727e (b5229549-5fc0-47c4-9326-b641a2ec727e): created successfully
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157cc37f-6442-4eed-a21c-455176b6d762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (3bee2fda-fa8b-4fb6-97cc-f82df5a3c141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:47 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8c3ccf13-3e36-4986-ae40-e029126f96f8 tempest-VolumesActionsTest-317159510 None] Created volume successfully.
Apr 20 18:42:47 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d 1073741824" returned: 0 in 0.711s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:47 devstack sudo[87924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:42:47 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-b5229549-5fc0-47c4-9326-b641a2ec727e-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-b5229549-5fc0-47c4-9326-b641a2ec727e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-quobyte-b5229549-5fc0-47c4-9326-b641a2ec727e" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-b5229549-5fc0-47c4-9326-b641a2ec727e" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afa4918-06a0-4337-a78d-959a8f27cf29]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:48 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e
Apr 20 18:42:48 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:48 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.573s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.658s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8daf53be-0bc0-43b0-98ac-100001b0f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e07418-d7fb-449e-8fd7-05d4e3a07098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b9439c-46ed-4fee-b35e-14f6dc10f3ac]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Volume volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d (42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d): created successfully
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e07418-d7fb-449e-8fd7-05d4e3a07098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (c05cac1a-b6b8-4277-9260-84f5566255d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:48 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-61aca6fe-0782-4e75-b6e7-35cd93068a01 tempest-VolumesSnapshotTestJSON-2046501300 None] Created volume successfully.
Apr 20 18:42:48 devstack sudo[87930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:48 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:48 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e" returned: 0 in 0.549s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:48 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e
Apr 20 18:42:48 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:49 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.495s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccbabfe-d3f4-474e-aced-25a6b4c6202f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:49 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:49 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:49 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b5229549-5fc0-47c4-9326-b641a2ec727e" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-b5229549-5fc0-47c4-9326-b641a2ec727e" released by "delete_volume" :: held 1.055s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Created reservations ['805994c5-d607-413f-a2eb-d67b7078325d', '1e9f86f1-5952-4f86-bb6d-4eb5c13ca280', 'c00e8884-36a1-47b5-bbd2-bbe06b95aeab', '4e8f050b-a241-4c9b-a5ae-a158616fe316'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:49 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:49 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:49 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.645s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:49 devstack sudo[87950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img
Apr 20 18:42:49 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:49 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.508s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:49 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Deleted volume successfully.
Apr 20 18:42:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-759b1b15-5e53-4e2f-bf64-f19ce918c2c0 tempest-VolumesActionsTest-1032879731 None] Lock "cinder-b5229549-5fc0-47c4-9326-b641a2ec727e-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (99fc39f6-1baf-4679-9c39-c533bb828d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d91c0e-779e-47ab-b7cd-89e24e5c492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d91c0e-779e-47ab-b7cd-89e24e5c492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900483488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43dac67-d9aa-469c-a3f4-4bddaf871202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:51Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbad79f-68be-4bb7-abb8-1e7b6bdefd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbad79f-68be-4bb7-abb8-1e7b6bdefd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795dcc79-3586-46d5-8db7-308b9f52c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795dcc79-3586-46d5-8db7-308b9f52c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43dac67-d9aa-469c-a3f4-4bddaf871202', 'volume_name': 'volume-b43dac67-d9aa-469c-a3f4-4bddaf871202', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027e7069-5fe9-428b-9d22-6f5908dcb578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027e7069-5fe9-428b-9d22-6f5908dcb578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0a4527-95a5-4b96-86aa-950b8d6e8cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:51 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Volume b43dac67-d9aa-469c-a3f4-4bddaf871202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43dac67-d9aa-469c-a3f4-4bddaf871202', 'volume_size': 1}
Apr 20 18:42:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:52 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img" returned: 0 in 2.754s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:52 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11a07ce-5474-415b-9e77-ed7ff4d2f6d4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:52 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:52 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:53 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.660s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:42:53 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Converted 1024.00 MB image at 371.57 MB/s
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] 9e965e09-70aa-455b-ba73-c445d7f8bec2 was raw, converting to qcow2 {{(pid=82268) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[99681355-fb88-44b8-bb70-de86c6971022]: (4, 'raw') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:53 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img
Apr 20 18:42:53 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:53 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img" returned: 0 in 0.514s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:53 devstack sudo[87974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img
Apr 20 18:42:53 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:54 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img" returned: 1 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img' failed. Not Retrying. {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:54 devstack sudo[87987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4
Apr 20 18:42:54 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:54 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4" returned: 0 in 0.491s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Image conversion details: src /opt/stack/data/cinder/conversion/add0b8d1-5d29-4ef2-9b1d-ce1d9745290b.temp_image.9e965e09-70aa-455b-ba73-c445d7f8bec2fdehx2n0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:42:54 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a74240e-c8c8-4190-8ca1-863cd1aa3166]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:54 devstack sudo[88009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4
Apr 20 18:42:54 devstack sudo[88009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:55 devstack sudo[88009]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oh11bnh4" returned: 0 in 0.461s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.476s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Uploaded volume to glance image-id: 9e965e09-70aa-455b-ba73-c445d7f8bec2. {{(pid=82268) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 20 18:42:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.232s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Creating offline snapshot 26680161-a041-445b-b61b-3d22a2107291 of volume 42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:42:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-892b34f3-57f4-4a2d-bfb8-6ba358a5d451 tempest-VolumesActionsTest-359768699 None] Copy volume to image completed successfully.
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c54bd7-6143-41a5-87ac-466ae063d429]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:56 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:42:56 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:56 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.488s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:56 devstack sudo[88022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 1G
Apr 20 18:42:56 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Acquiring lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Acquiring lock "cinder-quobyte-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Lock "cinder-quobyte-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe5951-dc9a-471f-8b24-a66a865ed686]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:42:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:56 devstack sudo[88024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:56 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:57 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 1G" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:57 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291
Apr 20 18:42:57 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:57 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.499s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:57 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b
Apr 20 18:42:57 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:57 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291" returned: 0 in 0.428s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:57 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 is being set with open permissions: ugo+rw
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:57 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291
Apr 20 18:42:57 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:57 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" returned: 0 in 0.444s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Lock "cinder-quobyte-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b" released by "delete_volume" :: held 0.965s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=116,cinder:SELECT=90,cinder:INSERT=24,cinder:DELETE=9 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=108,cinder:UPDATE=95,cinder:INSERT=26,cinder:DELETE=9 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Created reservations ['6b905bd0-e5e5-4891-86dd-aba458493f90', 'a398b1c8-a4b2-4e86-b4bf-5a1ddf442f37', '8cd159bc-3c61-4652-a292-318ba3ba35a5', '691a7921-8a3d-43d0-b8bd-1ac278adf743'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:57 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:42:57 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:57 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291" returned: 0 in 0.457s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:57 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info
Apr 20 18:42:57 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:58 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.433s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:42:58 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Deleted volume successfully.
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32f3c043-54db-4411-b63b-31780a3077fc tempest-VolumesActionsTest-359768699 None] Lock "cinder-add0b8d1-5d29-4ef2-9b1d-ce1d9745290b-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:42:58 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info" returned: 0 in 0.485s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:58 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info is being set with open permissions: ugo+rw
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:58 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info
Apr 20 18:42:58 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:58 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.info" returned: 0 in 0.414s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.882s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.326s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900483488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43dac67-d9aa-469c-a3f4-4bddaf871202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:51Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Creating volume b43dac67-d9aa-469c-a3f4-4bddaf871202 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:42:58 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:42:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:58 devstack sudo[88052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 1073741824
Apr 20 18:42:58 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:42:58 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b7197437-0403-47a1-b392-64d8384b1521 tempest-VolumesSnapshotTestJSON-2046501300 None] Create snapshot completed successfully
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (0309bd82-3da1-4995-ba8a-b3c1799a8d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0823ab-fcd5-48ec-884e-96b18e1ded12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0823ab-fcd5-48ec-884e-96b18e1ded12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1349391512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a376eb-9424-48ed-877b-37a406421ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf3ff8c4c104b24a1b8baea25e0f5eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26680161-a041-445b-b61b-3d22a2107291,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:42:59Z,use_quota=True,user_id='e8680178751246ecbb00f3fc5babfdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e781f3a-e1e2-42d7-a540-5d9c43efed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e781f3a-e1e2-42d7-a540-5d9c43efed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01426fcf-9aa3-4c75-b2c4-1ff156eb7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01426fcf-9aa3-4c75-b2c4-1ff156eb7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2a376eb-9424-48ed-877b-37a406421ae3', 'volume_name': 'volume-c2a376eb-9424-48ed-877b-37a406421ae3', 'volume_size': 1, 'snapshot_id': '26680161-a041-445b-b61b-3d22a2107291'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f81d8-4221-4231-a786-b5d25c9b7f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f81d8-4221-4231-a786-b5d25c9b7f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632324af-3127-4776-81b1-51b5572d262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:42:59 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Volume c2a376eb-9424-48ed-877b-37a406421ae3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2a376eb-9424-48ed-877b-37a406421ae3', 'volume_size': 1, 'snapshot_id': '26680161-a041-445b-b61b-3d22a2107291'}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:42:59 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 1073741824" returned: 0 in 0.642s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:42:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:42:59 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202
Apr 20 18:42:59 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:00 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.540s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-26680161-a041-445b-b61b-3d22a2107291-c2a376eb-9424-48ed-877b-37a406421ae3" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0a4527-95a5-4b96-86aa-950b8d6e8cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43dac67-d9aa-469c-a3f4-4bddaf871202', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5e6a32-c38b-41e6-a982-d81f5bc7d062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:00 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Volume volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 (b43dac67-d9aa-469c-a3f4-4bddaf871202): created successfully
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5e6a32-c38b-41e6-a982-d81f5bc7d062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (99fc39f6-1baf-4679-9c39-c533bb828d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-26680161-a041-445b-b61b-3d22a2107291-c2a376eb-9424-48ed-877b-37a406421ae3" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Creating volume c2a376eb-9424-48ed-877b-37a406421ae3 from snapshot 26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-c2a376eb-9424-48ed-877b-37a406421ae3" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-be16547c-b38f-4862-85d4-a3b1bd41c97d tempest-VolumesActionsTest-317159510 None] Created volume successfully.
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-c2a376eb-9424-48ed-877b-37a406421ae3" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] snapshot: 26680161-a041-445b-b61b-3d22a2107291, volume: c2a376eb-9424-48ed-877b-37a406421ae3,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c98e8-2ed7-427a-b07e-e3ed4b1ab78f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:00 devstack sudo[88061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291
Apr 20 18:43:00 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:00 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291" returned: 0 in 0.553s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caefae1-b32d-46ce-b46f-e385894c98c4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:00 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:43:00 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-b43dac67-d9aa-469c-a3f4-4bddaf871202-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Lock "cinder-b43dac67-d9aa-469c-a3f4-4bddaf871202-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Acquiring lock "cinder-quobyte-b43dac67-d9aa-469c-a3f4-4bddaf871202" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-b43dac67-d9aa-469c-a3f4-4bddaf871202" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8185f1f-f222-4ad8-8c8b-1af954811221]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:01 devstack sudo[88070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202
Apr 20 18:43:01 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:01 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.689s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:01 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:43:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:01 devstack sudo[88075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3
Apr 20 18:43:01 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:01 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202" returned: 0 in 0.677s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:01 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202
Apr 20 18:43:01 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:02 devstack sudo[88096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:02 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:02 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b43dac67-d9aa-469c-a3f4-4bddaf871202" returned: 0 in 1.181s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Lock "cinder-quobyte-b43dac67-d9aa-469c-a3f4-4bddaf871202" released by "delete_volume" :: held 1.892s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:02 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Created reservations ['ae41284d-af72-4cef-93a8-054a7438cbcf', '0f5a1785-399d-4870-ba3c-a6aac1eb555e', 'd16711a2-d75d-41af-af50-1d8b9684331b', '0caee3cd-52ac-42d1-8f80-893ebfe97988'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:03 devstack sudo[88099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:03 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:03 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (0384454a-ff72-45f8-b34f-def5fdcf1fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef540edc-daca-4ea4-a85c-0b50dadc34b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef540edc-daca-4ea4-a85c-0b50dadc34b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692303046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6da2739-90c6-4f63-b69d-735f485fff5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:04Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb26cb4b-82b2-4365-8ae3-c2f41c6c6989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb26cb4b-82b2-4365-8ae3-c2f41c6c6989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c51544-c897-405c-8873-5f1d5488d38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c51544-c897-405c-8873-5f1d5488d38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6da2739-90c6-4f63-b69d-735f485fff5b', 'volume_name': 'volume-b6da2739-90c6-4f63-b69d-735f485fff5b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa474b2-9979-4437-bc24-a5f515836df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa474b2-9979-4437-bc24-a5f515836df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9ffe0e-8358-4f3d-a907-699af8fc8261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:04 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Volume b6da2739-90c6-4f63-b69d-735f485fff5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6da2739-90c6-4f63-b69d-735f485fff5b', 'volume_size': 1}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.749s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:04 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3" returned: 0 in 3.191s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7785b1-fbb1-4e57-847e-d75ccd766e12]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:04 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.544s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:04 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Deleted volume successfully.
Apr 20 18:43:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5555fa99-2c38-4e85-b4ca-03909a9b041a tempest-VolumesActionsTest-1032879731 None] Lock "cinder-b43dac67-d9aa-469c-a3f4-4bddaf871202-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:04 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:43:04 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Flow 'volume_create_manager' (0f432a1d-6c19-4617-a402-f7da3024c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29d520a-40e2-4230-83ef-3b9bffd782f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29d520a-40e2-4230-83ef-3b9bffd782f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1358878537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e481b46-b04d-4337-b762-83e8d9438a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a54f3f67a3a4a8b94926873609b5b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:05Z,use_quota=True,user_id='56fd49a1098c4d7fa935acd30448ba22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68da16e1-b495-45c0-b4c6-48851b48ec25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68da16e1-b495-45c0-b4c6-48851b48ec25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9775d3b0-0a8b-42f9-a4b1-d3fe6522c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9775d3b0-0a8b-42f9-a4b1-d3fe6522c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e481b46-b04d-4337-b762-83e8d9438a01', 'volume_name': 'volume-7e481b46-b04d-4337-b762-83e8d9438a01', 'volume_size': 2}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf21ec7-e22f-4fba-a2e0-3d8165bbdc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf21ec7-e22f-4fba-a2e0-3d8165bbdc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0113092d-32cb-42fd-93be-885744e75be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Volume 7e481b46-b04d-4337-b762-83e8d9438a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e481b46-b04d-4337-b762-83e8d9438a01', 'volume_size': 2}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:05 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.735s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d, size 1024.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:43:05 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Converted 1024.00 MB image at 320.81 MB/s
Apr 20 18:43:05 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 is being set with open permissions: ugo+rw
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:05 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3
Apr 20 18:43:05 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:05 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-c2a376eb-9424-48ed-877b-37a406421ae3" released by "_copy_volume_from_snapshot" :: held 5.709s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-26680161-a041-445b-b61b-3d22a2107291-c2a376eb-9424-48ed-877b-37a406421ae3" released by "_create_volume_from_snapshot" :: held 5.727s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.758s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692303046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6da2739-90c6-4f63-b69d-735f485fff5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72492a783c904522b47b9da1543daed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:04Z,use_quota=True,user_id='266c0c48d56d47b8b948e1d5dec2f41f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Creating volume b6da2739-90c6-4f63-b69d-735f485fff5b {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:05 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:05 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b 1073741824
Apr 20 18:43:05 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632324af-3127-4776-81b1-51b5572d262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a376eb-9424-48ed-877b-37a406421ae3', 'volume_size': 1, 'snapshot_id': '26680161-a041-445b-b61b-3d22a2107291'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9393e11a-96dc-4813-a8b0-10b2b17eddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Volume volume-c2a376eb-9424-48ed-877b-37a406421ae3 (c2a376eb-9424-48ed-877b-37a406421ae3): created successfully
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9393e11a-96dc-4813-a8b0-10b2b17eddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Flow 'volume_create_manager' (0309bd82-3da1-4995-ba8a-b3c1799a8d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-47ef54b1-dc62-4c93-bd64-8bb1c27fedcc tempest-VolumesSnapshotTestJSON-2046501300 None] Created volume successfully.
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-c2a376eb-9424-48ed-877b-37a406421ae3-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-c2a376eb-9424-48ed-877b-37a406421ae3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-c2a376eb-9424-48ed-877b-37a406421ae3" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-c2a376eb-9424-48ed-877b-37a406421ae3" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[90260191-1255-497a-b5ca-7929adc23a17]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:06 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3
Apr 20 18:43:06 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:06 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b 1073741824" returned: 0 in 0.580s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:06 devstack sudo[88118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b
Apr 20 18:43:06 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:06 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3" returned: 0 in 0.633s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:06 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3
Apr 20 18:43:06 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:06 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.706s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1358878537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e481b46-b04d-4337-b762-83e8d9438a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a54f3f67a3a4a8b94926873609b5b2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:05Z,use_quota=True,user_id='56fd49a1098c4d7fa935acd30448ba22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Creating volume 7e481b46-b04d-4337-b762-83e8d9438a01 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:06 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01 2147483648 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c9ffe0e-8358-4f3d-a907-699af8fc8261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6da2739-90c6-4f63-b69d-735f485fff5b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:06 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01 2147483648
Apr 20 18:43:06 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb46a53-f503-481d-8ba6-f417c3e16e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:06 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Volume volume-b6da2739-90c6-4f63-b69d-735f485fff5b (b6da2739-90c6-4f63-b69d-735f485fff5b): created successfully
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb46a53-f503-481d-8ba6-f417c3e16e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Flow 'volume_create_manager' (0384454a-ff72-45f8-b34f-def5fdcf1fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-640cfabb-2074-4b90-b58b-e281698cab72 tempest-VolumesActionsTest-317159510 None] Created volume successfully.
Apr 20 18:43:07 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c2a376eb-9424-48ed-877b-37a406421ae3" returned: 0 in 0.497s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-c2a376eb-9424-48ed-877b-37a406421ae3" released by "delete_volume" :: held 1.158s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['f7071f69-1ff0-4ba5-99ef-517a5b46b4fd', '0d005d57-ef35-46af-91c1-341dd39e133d', 'f9f0bdd6-d369-4e12-9b42-64f7601f1736', 'c0e61b96-9b4e-4e02-9f4c-4fb0759bf563'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:07 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:07 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:07 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01 2147483648" returned: 0 in 0.607s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:07 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01
Apr 20 18:43:07 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:07 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:07 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Deleted volume successfully.
Apr 20 18:43:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b2e354ce-02ea-4894-ac3b-324f588f7932 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-c2a376eb-9424-48ed-877b-37a406421ae3-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:08 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0113092d-32cb-42fd-93be-885744e75be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e481b46-b04d-4337-b762-83e8d9438a01', 'volume_size': 2}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e1c241-9c5d-4da1-b376-563eb394919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Volume volume-7e481b46-b04d-4337-b762-83e8d9438a01 (7e481b46-b04d-4337-b762-83e8d9438a01): created successfully
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e1c241-9c5d-4da1-b376-563eb394919f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Flow 'volume_create_manager' (0f432a1d-6c19-4617-a402-f7da3024c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-62bd26d7-a7f2-4c36-8ed7-77a83e8dec94 tempest-VolumesCloneNegativeTest-913789833 None] Created volume successfully.
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-26680161-a041-445b-b61b-3d22a2107291-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-26680161-a041-445b-b61b-3d22a2107291-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-26680161-a041-445b-b61b-3d22a2107291" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-26680161-a041-445b-b61b-3d22a2107291" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Deleting offline snapshot 26680161-a041-445b-b61b-3d22a2107291 of volume 42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] snapshot_file for this snap is: volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[03657508-68ac-4abe-96c3-bfdeb833c1f9]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Acquiring lock "cinder-7e481b46-b04d-4337-b762-83e8d9438a01-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Lock "cinder-7e481b46-b04d-4337-b762-83e8d9438a01-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack sudo[88138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291
Apr 20 18:43:08 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Acquiring lock "cinder-quobyte-7e481b46-b04d-4337-b762-83e8d9438a01" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Lock "cinder-quobyte-7e481b46-b04d-4337-b762-83e8d9438a01" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Acquiring lock "cinder-b6da2739-90c6-4f63-b69d-735f485fff5b-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f68f7e-97b7-4590-9fe9-b312543aad07]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Lock "cinder-b6da2739-90c6-4f63-b69d-735f485fff5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Acquiring lock "cinder-quobyte-b6da2739-90c6-4f63-b69d-735f485fff5b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Lock "cinder-quobyte-b6da2739-90c6-4f63-b69d-735f485fff5b" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5028f2d-9fdb-443f-893c-ae9763ab0190]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:08 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01
Apr 20 18:43:08 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:08 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b
Apr 20 18:43:08 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:09 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291" returned: 0 in 0.664s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea6be3-5075-4404-bc04-56527ef0250a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:09 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:43:09 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:09 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b" returned: 0 in 0.623s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:09 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01" returned: 0 in 0.718s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:09 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b
Apr 20 18:43:09 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:09 devstack sudo[88162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01
Apr 20 18:43:09 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:09 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7e481b46-b04d-4337-b762-83e8d9438a01" returned: 0 in 0.586s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Lock "cinder-quobyte-7e481b46-b04d-4337-b762-83e8d9438a01" released by "delete_volume" :: held 1.352s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:09 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.851s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Created reservations ['4f8e5618-e46b-4852-a6a1-4742d761e7ee', '274b142c-51b5-4635-a7e5-4b1afeb87993', '0ccd2be5-a5ec-425a-9826-cdc78483a7c0', '9fbfd1a5-9fc8-4014-8b0a-e03d8ca584ac'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:09 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:09 devstack sudo[88170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291
Apr 20 18:43:09 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b6da2739-90c6-4f63-b69d-735f485fff5b" returned: 0 in 0.725s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Lock "cinder-quobyte-b6da2739-90c6-4f63-b69d-735f485fff5b" released by "delete_volume" :: held 1.387s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:10 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:10 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Created reservations ['055e8fc2-3544-419b-8b8f-0b17b3b72eb9', '140c819b-3125-4de2-b95a-6555a64f5f74', 'f5b8325f-1abd-42f7-af70-a2a19505ce4f', '6430db59-100e-4f23-9350-3a4f5eb0295f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:10 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:10 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:10 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.525s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Deleted volume successfully.
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4223797f-f8dc-4689-9913-d2a7a4d61620 tempest-VolumesCloneNegativeTest-913789833 None] Lock "cinder-7e481b46-b04d-4337-b762-83e8d9438a01-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:10 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291" returned: 0 in 0.708s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:10 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291
Apr 20 18:43:10 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:10 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.762s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Deleted volume successfully.
Apr 20 18:43:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f12d4c5-1600-41f8-84bc-417fe2c0ce72 tempest-VolumesActionsTest-317159510 None] Lock "cinder-b6da2739-90c6-4f63-b69d-735f485fff5b-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:11 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d.26680161-a041-445b-b61b-3d22a2107291" returned: 0 in 0.665s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-26680161-a041-445b-b61b-3d22a2107291" released by "_delete_snapshot" :: held 3.009s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" released by "delete_snapshot" :: held 3.026s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['9e9568c5-8e5d-424a-92ef-b7d61101d29f', '19999e0c-e8cd-4df3-807d-0322ce0ecf5e', '260180a4-66f2-4a98-bb85-624873111827', '6929e98e-f890-4849-b19a-6494695fdca1'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Delete snapshot completed successfully.
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6497e289-d53c-4d1d-ba0c-b56a939afb0a tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-26680161-a041-445b-b61b-3d22a2107291-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[608ba71c-9064-4530-ae65-3ed5c132bd92]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:11 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:43:11 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:12 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.717s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:12 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d
Apr 20 18:43:12 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:12 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" returned: 0 in 0.613s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d" released by "delete_volume" :: held 1.364s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['859b0e4d-ac1b-49a1-8b38-27299d333f75', 'a8e39ca7-8498-4216-ba8c-d289eab0cf43', 'a7983759-aa13-45a3-99a3-2ed54d7aa7ab', '4a2d587a-935b-4307-b51f-d0700459ec8a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:13 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:13 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Flow 'volume_create_manager' (6312cfe8-90c9-4f14-b4c2-68c75f0b1b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb364c9-2085-4713-8703-d72bb446bf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb364c9-2085-4713-8703-d72bb446bf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1659873860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e00e08-0d54-46b7-90e2-d981edd8d070,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ddeae09447649ad9548bd5fff436266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:13Z,use_quota=True,user_id='24ed8fff2b7546f18d8488a26a6ccb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7996beb-a296-490e-8b43-7a6a4aff6a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7996beb-a296-490e-8b43-7a6a4aff6a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21c8ef4-b34b-46bc-8345-a7213781b5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21c8ef4-b34b-46bc-8345-a7213781b5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e00e08-0d54-46b7-90e2-d981edd8d070', 'volume_name': 'volume-62e00e08-0d54-46b7-90e2-d981edd8d070', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e284689c-460b-4b9f-aa24-c878b23fe2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e284689c-460b-4b9f-aa24-c878b23fe2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dbea423-dab0-4a9a-a6bc-fd748e1e7803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:13 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Volume 62e00e08-0d54-46b7-90e2-d981edd8d070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e00e08-0d54-46b7-90e2-d981edd8d070', 'volume_size': 1}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1659873860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e00e08-0d54-46b7-90e2-d981edd8d070,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ddeae09447649ad9548bd5fff436266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:13Z,use_quota=True,user_id='24ed8fff2b7546f18d8488a26a6ccb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Creating volume 62e00e08-0d54-46b7-90e2-d981edd8d070 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:13 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:13 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070 1073741824
Apr 20 18:43:13 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:13 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.552s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Deleted volume successfully.
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0f8a2882-b8a0-4b5d-823f-ca2c2e520b98 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-42d45a5f-d605-4d10-98fd-a1cbeb3f9e5d-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-6fd857e0-a684-4d8a-9348-171b714dcd5a-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-6fd857e0-a684-4d8a-9348-171b714dcd5a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "cinder-quobyte-6fd857e0-a684-4d8a-9348-171b714dcd5a" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-6fd857e0-a684-4d8a-9348-171b714dcd5a" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea7e315-077b-4d98-a41c-7a9f57cfc92d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:13 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070 1073741824" returned: 0 in 0.617s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:14 devstack sudo[88206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a
Apr 20 18:43:14 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:14 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070
Apr 20 18:43:14 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:14 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dbea423-dab0-4a9a-a6bc-fd748e1e7803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e00e08-0d54-46b7-90e2-d981edd8d070', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fb33b1-db4e-45d4-bd41-d5dfc9a4c2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:14 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Volume volume-62e00e08-0d54-46b7-90e2-d981edd8d070 (62e00e08-0d54-46b7-90e2-d981edd8d070): created successfully
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fb33b1-db4e-45d4-bd41-d5dfc9a4c2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Flow 'volume_create_manager' (6312cfe8-90c9-4f14-b4c2-68c75f0b1b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-00312fea-6090-4ff6-ba28-b0cc1468185a tempest-VolumesListTestJSON-92515601 None] Created volume successfully.
Apr 20 18:43:14 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a" returned: 0 in 0.545s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:14 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a
Apr 20 18:43:14 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:14 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6fd857e0-a684-4d8a-9348-171b714dcd5a" returned: 0 in 0.504s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-quobyte-6fd857e0-a684-4d8a-9348-171b714dcd5a" released by "delete_volume" :: held 1.104s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Created reservations ['cbc172eb-da43-49d2-8caf-5dcd9a3937f9', 'b5fa334f-bbdc-4a35-a72d-445127a1374b', '0e07221e-1849-415f-a929-8c7271b604ee', '393a5b12-38bf-40a1-a8ce-13e047dc05e7'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:15 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:15 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:15 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.412s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:15 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Deleted volume successfully.
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4e142f45-7d8a-49c8-a8fe-48ca8ffb90b3 tempest-VolumesSnapshotTestJSON-2046501300 None] Lock "cinder-6fd857e0-a684-4d8a-9348-171b714dcd5a-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Flow 'volume_create_manager' (b2ab8097-dd2b-4229-b282-07de2075438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f0d36-5b22-48a7-8634-c6ce710446e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764f0d36-5b22-48a7-8634-c6ce710446e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1326632922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44725827-08c5-4595-860d-4bffc8d96627,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ddeae09447649ad9548bd5fff436266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:16Z,use_quota=True,user_id='24ed8fff2b7546f18d8488a26a6ccb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647c30bc-18b5-4aef-ba52-d26973e720e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647c30bc-18b5-4aef-ba52-d26973e720e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7cdff1-2a14-4773-88a3-ab6dd92100be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7cdff1-2a14-4773-88a3-ab6dd92100be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44725827-08c5-4595-860d-4bffc8d96627', 'volume_name': 'volume-44725827-08c5-4595-860d-4bffc8d96627', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feedb1c1-2ccc-427f-b0cc-f6422e6759c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feedb1c1-2ccc-427f-b0cc-f6422e6759c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf558d5-7b03-4c05-bf2a-9a97e3a0ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:15 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Volume 44725827-08c5-4595-860d-4bffc8d96627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44725827-08c5-4595-860d-4bffc8d96627', 'volume_size': 1}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1326632922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44725827-08c5-4595-860d-4bffc8d96627,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ddeae09447649ad9548bd5fff436266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:16Z,use_quota=True,user_id='24ed8fff2b7546f18d8488a26a6ccb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Creating volume 44725827-08c5-4595-860d-4bffc8d96627 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:15 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:15 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627 1073741824
Apr 20 18:43:15 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:16 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627 1073741824" returned: 0 in 0.497s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:16 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627
Apr 20 18:43:16 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:16 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf558d5-7b03-4c05-bf2a-9a97e3a0ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44725827-08c5-4595-860d-4bffc8d96627', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d992a2a-b0be-45e3-ac75-e3b2006c8809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:16 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Volume volume-44725827-08c5-4595-860d-4bffc8d96627 (44725827-08c5-4595-860d-4bffc8d96627): created successfully
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d992a2a-b0be-45e3-ac75-e3b2006c8809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Flow 'volume_create_manager' (b2ab8097-dd2b-4229-b282-07de2075438b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5eaa61c2-765b-43ce-8d6b-66e87d0dc921 tempest-VolumesListTestJSON-92515601 None] Created volume successfully.
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Flow 'volume_create_manager' (1ad534e4-3a94-4d8e-905b-2f6c52723c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419875fa-a93b-42f1-b7ae-472e487df19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419875fa-a93b-42f1-b7ae-472e487df19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1645682077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69c9763-26f6-4334-8e96-5af57327bbea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ddeae09447649ad9548bd5fff436266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:18Z,use_quota=True,user_id='24ed8fff2b7546f18d8488a26a6ccb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89b81d4-e5a6-43b3-a184-67d07c5172f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89b81d4-e5a6-43b3-a184-67d07c5172f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2838800c-f032-41d4-82ee-091a991024f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2838800c-f032-41d4-82ee-091a991024f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c69c9763-26f6-4334-8e96-5af57327bbea', 'volume_name': 'volume-c69c9763-26f6-4334-8e96-5af57327bbea', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f766fa4-70ef-4b15-95df-3371e027d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f766fa4-70ef-4b15-95df-3371e027d672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da82141-7ba3-43b6-92ce-f11d40918970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:18 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Volume c69c9763-26f6-4334-8e96-5af57327bbea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c69c9763-26f6-4334-8e96-5af57327bbea', 'volume_size': 1}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1645682077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69c9763-26f6-4334-8e96-5af57327bbea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ddeae09447649ad9548bd5fff436266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:18Z,use_quota=True,user_id='24ed8fff2b7546f18d8488a26a6ccb90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Creating volume c69c9763-26f6-4334-8e96-5af57327bbea {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:18 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:18 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea 1073741824
Apr 20 18:43:18 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:18 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea 1073741824" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:18 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea
Apr 20 18:43:18 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:19 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea" returned: 0 in 0.628s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da82141-7ba3-43b6-92ce-f11d40918970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69c9763-26f6-4334-8e96-5af57327bbea', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf5e538-8d1a-4091-b8d7-8bae7e6f4efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:19 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Volume volume-c69c9763-26f6-4334-8e96-5af57327bbea (c69c9763-26f6-4334-8e96-5af57327bbea): created successfully
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf5e538-8d1a-4091-b8d7-8bae7e6f4efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Flow 'volume_create_manager' (1ad534e4-3a94-4d8e-905b-2f6c52723c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:19 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e3641b2d-2b9d-4505-921f-7324608961ee tempest-VolumesListTestJSON-92515601 None] Created volume successfully.
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Flow 'volume_create_manager' (25af6b6a-29f5-4b58-8838-3cf22bcaa07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d76607-8725-4988-b860-7dd39503e43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d76607-8725-4988-b860-7dd39503e43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1287518466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247f8c51-f157-4764-8ddb-57d110456746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fffed52ebb9441dfa94c6e3e5ec68617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:22Z,use_quota=True,user_id='260f98ec1c564ca69c29a2d9063ca2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1954e76e-ef0c-4125-ab8b-0915d1c83372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1954e76e-ef0c-4125-ab8b-0915d1c83372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637c3d2-8f86-42f5-b004-8598f523b68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637c3d2-8f86-42f5-b004-8598f523b68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247f8c51-f157-4764-8ddb-57d110456746', 'volume_name': 'volume-247f8c51-f157-4764-8ddb-57d110456746', 'volume_size': 2}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cddd5d-a486-485e-a7ea-5d1571fd7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cddd5d-a486-485e-a7ea-5d1571fd7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906d0433-7be1-4411-9d9c-e85afe33b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:21 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Volume 247f8c51-f157-4764-8ddb-57d110456746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247f8c51-f157-4764-8ddb-57d110456746', 'volume_size': 2}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1287518466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=247f8c51-f157-4764-8ddb-57d110456746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fffed52ebb9441dfa94c6e3e5ec68617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:22Z,use_quota=True,user_id='260f98ec1c564ca69c29a2d9063ca2cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Creating volume 247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:21 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 2147483648 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:21 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 2147483648
Apr 20 18:43:21 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Acquiring lock "cinder-c69c9763-26f6-4334-8e96-5af57327bbea-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Lock "cinder-c69c9763-26f6-4334-8e96-5af57327bbea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Acquiring lock "cinder-quobyte-c69c9763-26f6-4334-8e96-5af57327bbea" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Lock "cinder-quobyte-c69c9763-26f6-4334-8e96-5af57327bbea" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacf2a0-6aa3-4ff9-af31-601374dd0a96]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:22 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea
Apr 20 18:43:22 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:22 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 2147483648" returned: 0 in 0.713s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:22 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746
Apr 20 18:43:22 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:22 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea" returned: 0 in 0.620s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:22 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea
Apr 20 18:43:22 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:23 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746" returned: 0 in 0.477s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (906d0433-7be1-4411-9d9c-e85afe33b656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247f8c51-f157-4764-8ddb-57d110456746', 'volume_size': 2}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854c823-6800-4fae-ad2d-1b8506981823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Volume volume-247f8c51-f157-4764-8ddb-57d110456746 (247f8c51-f157-4764-8ddb-57d110456746): created successfully
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b854c823-6800-4fae-ad2d-1b8506981823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Flow 'volume_create_manager' (25af6b6a-29f5-4b58-8838-3cf22bcaa07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:23 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6ea6f6ac-a06e-4914-baf1-f2fa48a43e54 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Created volume successfully.
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Flow 'volume_create_manager' (53446a90-1e0b-4a8f-89c3-796f4d4faee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adc4000-c408-43b1-8d52-0fc4fca55cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adc4000-c408-43b1-8d52-0fc4fca55cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1220459545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef779f0-4721-4bea-99af-f9c4d6b20825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9809ddfe7143d394fa365f5007d68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:23Z,use_quota=True,user_id='1db372918f7d424bb7d302d0b8afcbb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9545e450-df92-4288-9caf-0cabc18a2b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9545e450-df92-4288-9caf-0cabc18a2b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887ba0f4-7f56-496b-b1ce-53b2f936f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887ba0f4-7f56-496b-b1ce-53b2f936f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef779f0-4721-4bea-99af-f9c4d6b20825', 'volume_name': 'volume-5ef779f0-4721-4bea-99af-f9c4d6b20825', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685ce18a-e741-428a-8575-e46b5e7b54da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (685ce18a-e741-428a-8575-e46b5e7b54da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fcaaad-ae02-47f2-95f8-170c08ed379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Volume 5ef779f0-4721-4bea-99af-f9c4d6b20825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef779f0-4721-4bea-99af-f9c4d6b20825', 'volume_size': 1}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1220459545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef779f0-4721-4bea-99af-f9c4d6b20825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a9809ddfe7143d394fa365f5007d68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:23Z,use_quota=True,user_id='1db372918f7d424bb7d302d0b8afcbb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Creating volume 5ef779f0-4721-4bea-99af-f9c4d6b20825 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:23 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:23 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 1073741824
Apr 20 18:43:23 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:23 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-c69c9763-26f6-4334-8e96-5af57327bbea" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Lock "cinder-quobyte-c69c9763-26f6-4334-8e96-5af57327bbea" released by "delete_volume" :: held 1.092s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Created reservations ['70d324cf-9041-4ed2-bb8d-54bbec928d21', 'a34ba531-e628-4178-9396-ec46b375b3c2', 'c7118b66-7e88-409b-82fe-0bcd44328e3e', '55d183eb-f8fc-4178-ab41-783070ca1183'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:23 devstack sudo[88317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:23 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:23 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 1073741824" returned: 0 in 0.515s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:23 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825
Apr 20 18:43:23 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:24 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.515s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:24 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Deleted volume successfully.
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b1b51915-ecb2-4541-9542-f190f5caccca tempest-VolumesListTestJSON-92515601 None] Lock "cinder-c69c9763-26f6-4334-8e96-5af57327bbea-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:24 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.245s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Creating offline snapshot f7dedcfe-d17b-4961-855b-22be28a64adb of volume 247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fcaaad-ae02-47f2-95f8-170c08ed379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef779f0-4721-4bea-99af-f9c4d6b20825', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88b8cc2-c965-45d8-9bb1-1fd4b6bc23f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e503af-dce3-495c-a5ef-89ef20806318]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:24 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Volume volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 (5ef779f0-4721-4bea-99af-f9c4d6b20825): created successfully
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88b8cc2-c965-45d8-9bb1-1fd4b6bc23f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Flow 'volume_create_manager' (53446a90-1e0b-4a8f-89c3-796f4d4faee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:24 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-28675791-315e-44f3-ad3e-73d0f5dda471 tempest-VolumesMetadataTest-1853021818 None] Created volume successfully.
Apr 20 18:43:24 devstack sudo[88326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746
Apr 20 18:43:24 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Acquiring lock "cinder-44725827-08c5-4595-860d-4bffc8d96627-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Lock "cinder-44725827-08c5-4595-860d-4bffc8d96627-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Acquiring lock "cinder-quobyte-44725827-08c5-4595-860d-4bffc8d96627" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Lock "cinder-quobyte-44725827-08c5-4595-860d-4bffc8d96627" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab44f00-a30b-4f2d-9818-081e983dd6d4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:24 devstack sudo[88354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627
Apr 20 18:43:24 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:24 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746" returned: 0 in 0.734s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb 2G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:24 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb 2G
Apr 20 18:43:24 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:25 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627" returned: 0 in 0.711s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:25 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627
Apr 20 18:43:25 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:25 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb 2G" returned: 0 in 0.612s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247f8c51-f157-4764-8ddb-57d110456746 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:25 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247f8c51-f157-4764-8ddb-57d110456746 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb
Apr 20 18:43:25 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:25 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44725827-08c5-4595-860d-4bffc8d96627" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Lock "cinder-quobyte-44725827-08c5-4595-860d-4bffc8d96627" released by "delete_volume" :: held 1.258s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Acquiring lock "cinder-5ef779f0-4721-4bea-99af-f9c4d6b20825-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Lock "cinder-5ef779f0-4721-4bea-99af-f9c4d6b20825-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Created reservations ['93a780cd-e4c1-4c79-8ddf-6017e1dbbf32', 'f6a5063e-23e6-4a15-9d80-c2735366ce9e', 'd7d8b9e7-8770-4608-94ce-d0ae2f86bdc9', 'd9700af8-63a2-463f-bd1d-7733916023e2'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Acquiring lock "cinder-quobyte-5ef779f0-4721-4bea-99af-f9c4d6b20825" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Lock "cinder-quobyte-5ef779f0-4721-4bea-99af-f9c4d6b20825" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bcecce-7367-4772-be12-1079295c73a2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:26 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:26 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:26 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825
Apr 20 18:43:26 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:26 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247f8c51-f157-4764-8ddb-57d110456746 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb" returned: 0 in 0.702s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:26 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb is being set with open permissions: ugo+rw
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:26 devstack sudo[88381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb
Apr 20 18:43:26 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:26 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:26 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Deleted volume successfully.
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f47f4688-9bfe-4d01-b6f8-30fa76b30b1d tempest-VolumesListTestJSON-92515601 None] Lock "cinder-44725827-08c5-4595-860d-4bffc8d96627-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:26 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825" returned: 0 in 0.677s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:26 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb" returned: 0 in 0.451s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:26 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825
Apr 20 18:43:26 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Acquiring lock "cinder-62e00e08-0d54-46b7-90e2-d981edd8d070-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:26 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info
Apr 20 18:43:26 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Lock "cinder-62e00e08-0d54-46b7-90e2-d981edd8d070-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Acquiring lock "cinder-quobyte-62e00e08-0d54-46b7-90e2-d981edd8d070" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Lock "cinder-quobyte-62e00e08-0d54-46b7-90e2-d981edd8d070" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb98468-4db3-4e9b-bac6-dd0522f26875]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:26 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070
Apr 20 18:43:26 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:27 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5ef779f0-4721-4bea-99af-f9c4d6b20825" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Lock "cinder-quobyte-5ef779f0-4721-4bea-99af-f9c4d6b20825" released by "delete_volume" :: held 1.211s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Created reservations ['9fbfd214-046b-44fc-9c36-07509442c19c', 'dce0b4c8-870c-459b-9394-5120ad1bf976', '6ffe578d-5b55-4bee-b8fa-e4d280a5c1f5', '85c2a3f5-8839-4e9c-a8bd-a7efa9846ff7'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:27 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:27 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:27 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info" returned: 0 in 0.646s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:27 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info is being set with open permissions: ugo+rw
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:27 devstack sudo[88401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info
Apr 20 18:43:27 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:27 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070" returned: 0 in 0.621s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:27 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070
Apr 20 18:43:27 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:27 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Deleted volume successfully.
Apr 20 18:43:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-99fc178e-cf80-4d01-ba3a-cee48ee35119 tempest-VolumesMetadataTest-1853021818 None] Lock "cinder-5ef779f0-4721-4bea-99af-f9c4d6b20825-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:28 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.info" returned: 0 in 0.595s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.840s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a5f27772-8553-48c7-9d17-4fbf83e6f746 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Create snapshot completed successfully
Apr 20 18:43:28 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-62e00e08-0d54-46b7-90e2-d981edd8d070" returned: 0 in 0.564s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Lock "cinder-quobyte-62e00e08-0d54-46b7-90e2-d981edd8d070" released by "delete_volume" :: held 1.216s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Created reservations ['bdd9cddc-a3e8-4896-aff0-499737f23fd7', '01d51fab-6202-4ad5-99f2-bdadf53c2672', 'f4d46da9-707a-405a-9031-5b1de7cc3f88', '05173914-3122-40d0-8ee3-bd394402b307'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:28 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:28 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "cinder-f7dedcfe-d17b-4961-855b-22be28a64adb-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-f7dedcfe-d17b-4961-855b-22be28a64adb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "cinder-quobyte-247f8c51-f157-4764-8ddb-57d110456746" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-quobyte-247f8c51-f157-4764-8ddb-57d110456746" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "cinder-quobyte-f7dedcfe-d17b-4961-855b-22be28a64adb" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-quobyte-f7dedcfe-d17b-4961-855b-22be28a64adb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Deleting offline snapshot f7dedcfe-d17b-4961-855b-22be28a64adb of volume 247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] snapshot_file for this snap is: volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6525f103-2731-44bb-b8f0-8f8750039b78]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:28 devstack sudo[88413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb
Apr 20 18:43:28 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:28 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.658s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Deleted volume successfully.
Apr 20 18:43:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-83634966-ea84-4d99-987f-ac267a58e720 tempest-VolumesListTestJSON-92515601 None] Lock "cinder-62e00e08-0d54-46b7-90e2-d981edd8d070-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:29 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb" returned: 0 in 0.802s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247f8c51-f157-4764-8ddb-57d110456746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cc60eb-9650-4d9f-869f-9e5d91271ca0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:29 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746
Apr 20 18:43:29 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:29 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746" returned: 0 in 0.683s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:29 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb
Apr 20 18:43:29 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Flow 'volume_create_manager' (87250170-13ef-4741-9f42-97f54e9aa96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e07f5c4-2164-4fdf-aba7-5314261d2d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e07f5c4-2164-4fdf-aba7-5314261d2d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-8787447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89360be7208a48f1a6dac166eb4b6b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:30Z,use_quota=True,user_id='06fab75e26614d8a8b12f9d88c2309fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd0002c-b02a-476e-ae82-396ca7e5edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd0002c-b02a-476e-ae82-396ca7e5edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ed687a-be77-4b84-9ba2-e8dbe3c8df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ed687a-be77-4b84-9ba2-e8dbe3c8df73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3', 'volume_name': 'volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98a7f41-e2b4-4ca1-bc78-eedbc577f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98a7f41-e2b4-4ca1-bc78-eedbc577f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442c349-2afc-40bd-8193-ef5aa810c36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:30 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3', 'volume_size': 1}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-8787447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89360be7208a48f1a6dac166eb4b6b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:30Z,use_quota=True,user_id='06fab75e26614d8a8b12f9d88c2309fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Creating volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:30 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:30 devstack sudo[88430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 1073741824
Apr 20 18:43:30 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:30 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb" returned: 0 in 0.710s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:30 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb
Apr 20 18:43:30 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:31 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746.f7dedcfe-d17b-4961-855b-22be28a64adb" returned: 0 in 0.533s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:31 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 1073741824" returned: 0 in 0.667s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-quobyte-f7dedcfe-d17b-4961-855b-22be28a64adb" released by "_delete_snapshot" :: held 2.798s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-quobyte-247f8c51-f157-4764-8ddb-57d110456746" released by "delete_snapshot" :: held 2.817s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:31 devstack sudo[88439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3
Apr 20 18:43:31 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (b543f129-5085-48fe-a18c-3dd196fa7812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0589e19c-c41a-410e-b630-923f531d5ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0589e19c-c41a-410e-b630-923f531d5ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844832120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858155c8-8e26-47bd-9ecb-de239175bf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:31Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf7a6c4-fb0b-47af-affa-e3ddc8d57eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf7a6c4-fb0b-47af-affa-e3ddc8d57eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00d52ea-ac8e-4608-9994-4111a0b5a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00d52ea-ac8e-4608-9994-4111a0b5a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '858155c8-8e26-47bd-9ecb-de239175bf0a', 'volume_name': 'volume-858155c8-8e26-47bd-9ecb-de239175bf0a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34385de-70db-4dfe-b990-fcc0fa3a01ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34385de-70db-4dfe-b990-fcc0fa3a01ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7212fe3b-8e98-41d7-acd4-f9b317ff2081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume 858155c8-8e26-47bd-9ecb-de239175bf0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-858155c8-8e26-47bd-9ecb-de239175bf0a', 'volume_size': 1}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Created reservations ['f3a754f8-f9a8-4f55-9bb9-241be6ecf333', '60d4a954-848a-491e-9dcc-2adbd7b73488', '620bea63-918a-4b4b-8d3a-3c902a91bd70', '586239da-5309-4676-9beb-bc835cc6762c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:31 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Delete snapshot completed successfully.
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5b17d800-1d38-4f87-bca9-ea2bb2d5d64d tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-f7dedcfe-d17b-4961-855b-22be28a64adb-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "cinder-247f8c51-f157-4764-8ddb-57d110456746-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-247f8c51-f157-4764-8ddb-57d110456746-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "cinder-quobyte-247f8c51-f157-4764-8ddb-57d110456746" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-quobyte-247f8c51-f157-4764-8ddb-57d110456746" acquired by "delete_volume" :: waited 0.028s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6124c143-f15c-4eef-998a-68059d36be76]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:31 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" returned: 0 in 0.531s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1844832120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858155c8-8e26-47bd-9ecb-de239175bf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:31Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating volume 858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:31 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:31 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746
Apr 20 18:43:31 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442c349-2afc-40bd-8193-ef5aa810c36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b640c53b-5520-405a-9f96-b39120401949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:31 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a 1073741824
Apr 20 18:43:31 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Volume volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 (cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3): created successfully
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b640c53b-5520-405a-9f96-b39120401949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Flow 'volume_create_manager' (87250170-13ef-4741-9f42-97f54e9aa96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:31 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7b0d6935-8bb3-43ed-ba06-c19388c57356 tempest-VolumesSnapshotListTestJSON-725121273 None] Created volume successfully.
Apr 20 18:43:32 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746" returned: 0 in 0.528s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:32 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746
Apr 20 18:43:32 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:32 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a 1073741824" returned: 0 in 0.571s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:32 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a
Apr 20 18:43:32 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:32 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-247f8c51-f157-4764-8ddb-57d110456746" returned: 0 in 0.594s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-quobyte-247f8c51-f157-4764-8ddb-57d110456746" released by "delete_volume" :: held 1.170s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:32 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a" returned: 0 in 0.493s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.174s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Creating offline snapshot 0f3ad857-df98-4391-a2b8-93ee327a0d74 of volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7212fe3b-8e98-41d7-acd4-f9b317ff2081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858155c8-8e26-47bd-9ecb-de239175bf0a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51345fef-fe6c-4f98-bd95-4fbe653b47ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[70552c11-904d-4d83-a527-8c3c8508d74c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:32 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume volume-858155c8-8e26-47bd-9ecb-de239175bf0a (858155c8-8e26-47bd-9ecb-de239175bf0a): created successfully
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51345fef-fe6c-4f98-bd95-4fbe653b47ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (b543f129-5085-48fe-a18c-3dd196fa7812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-bc8710b4-cd1e-4899-91b4-679ddf571d32 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created volume successfully.
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Created reservations ['c3ba7b59-1138-44fa-86fc-fc69568250a4', '3d3e9665-0f13-4e84-8669-5156c20a8765', 'fcd867e1-e178-47f8-a849-63140701d7a2', '585d7356-98c7-464d-bc4d-22308a76bf6f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:32 devstack sudo[88458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3
Apr 20 18:43:32 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:32 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:32 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:33 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" returned: 0 in 0.747s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:33 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 1G
Apr 20 18:43:33 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:33 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.690s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:33 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Deleted volume successfully.
Apr 20 18:43:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5359c75-ab91-45f1-ad95-fdea8bdd16d4 tempest-VolumesSnapshotNegativeTestJSON-256531363 None] Lock "cinder-247f8c51-f157-4764-8ddb-57d110456746-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:34 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 1G" returned: 0 in 0.662s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:34 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:43:34 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:34 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.584s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:34 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 is being set with open permissions: ugo+rw
Apr 20 18:43:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:34 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:43:34 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:35 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.533s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:35 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info
Apr 20 18:43:35 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:35 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:35 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info is being set with open permissions: ugo+rw
Apr 20 18:43:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:35 devstack sudo[88498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info
Apr 20 18:43:35 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:36 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.info" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.664s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.991s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-76a46fdd-5d92-4778-b6e3-53b7e689652f tempest-VolumesSnapshotListTestJSON-725121273 None] Create snapshot completed successfully
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating offline snapshot 9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 of volume 858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[208de929-8126-4ddf-b22f-13c138aa845c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:36 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a
Apr 20 18:43:36 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:37 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a" returned: 0 in 0.611s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:37 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 1G
Apr 20 18:43:37 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:37 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 1G" returned: 0 in 0.517s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858155c8-8e26-47bd-9ecb-de239175bf0a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:37 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858155c8-8e26-47bd-9ecb-de239175bf0a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1
Apr 20 18:43:37 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:38 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-858155c8-8e26-47bd-9ecb-de239175bf0a -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" returned: 0 in 0.606s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:38 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 is being set with open permissions: ugo+rw
Apr 20 18:43:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:38 devstack sudo[88519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1
Apr 20 18:43:38 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:38 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" returned: 0 in 0.490s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:38 devstack sudo[88522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info
Apr 20 18:43:38 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:39 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info" returned: 0 in 0.596s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:39 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info is being set with open permissions: ugo+rw
Apr 20 18:43:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:39 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info
Apr 20 18:43:39 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:40 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.info" returned: 0 in 0.765s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.684s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.257s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Creating offline snapshot 6f0d9c74-92dc-46a5-86f0-2917b35dda84 of volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:43:40 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-90fefd4d-b7b0-4972-bf9c-82c8f01f6ed8 tempest-CreateVolumesFromSnapshotTest-528178686 None] Create snapshot completed successfully
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a90ffa-0736-4a45-b5e1-561220512a6c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:40 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:43:40 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:40 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.677s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:40 devstack sudo[88559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 1G
Apr 20 18:43:40 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (eeb1b890-109b-4434-902c-4eed9d420da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859d7766-8277-4523-a49c-64d39982f23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859d7766-8277-4523-a49c-64d39982f23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132972964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ce642e-4b8d-488c-9774-8db73a42f6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:41Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c711a0e-2944-4f40-a66b-d006e07f2e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c711a0e-2944-4f40-a66b-d006e07f2e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8831b7-091c-4f46-bc72-13f1e1169c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8831b7-091c-4f46-bc72-13f1e1169c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ce642e-4b8d-488c-9774-8db73a42f6ef', 'volume_name': 'volume-10ce642e-4b8d-488c-9774-8db73a42f6ef', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7b8f85-de11-41e5-b902-94c7155805e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7b8f85-de11-41e5-b902-94c7155805e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37f97e2-d225-4386-890e-e4552f255da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume 10ce642e-4b8d-488c-9774-8db73a42f6ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ce642e-4b8d-488c-9774-8db73a42f6ef', 'volume_size': 1}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (483a94da-be69-49f4-b41c-aa8d37f02757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b08a5a-6f67-4af0-9d95-02132f6d66c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b08a5a-6f67-4af0-9d95-02132f6d66c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1277428566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a47c4c-04fc-4f10-8a70-74afb4ba5690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:42Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ae9cb7-b300-4d5e-b92c-02ce4cf23527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ae9cb7-b300-4d5e-b92c-02ce4cf23527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8ac5de-76eb-4c48-815c-3c2177ca289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8ac5de-76eb-4c48-815c-3c2177ca289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73a47c4c-04fc-4f10-8a70-74afb4ba5690', 'volume_name': 'volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ef0f70-8b73-4b29-9ffb-f0a02fcda7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ef0f70-8b73-4b29-9ffb-f0a02fcda7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b87e23-2f92-45a1-a135-11381e3dfcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume 73a47c4c-04fc-4f10-8a70-74afb4ba5690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690', 'volume_size': 1}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:41 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 1G" returned: 0 in 1.019s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:41 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:41 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (95147360-259f-4226-b5c6-ddb4b4c22469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9449f8b-bec8-4b0b-947a-286f069cfed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9449f8b-bec8-4b0b-947a-286f069cfed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374836085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1affa16-b802-4718-89d9-d1fb4bcb86ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:42Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312829c5-64ca-48b3-b4eb-e3a29c8c4373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312829c5-64ca-48b3-b4eb-e3a29c8c4373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef80a669-e7ef-4a1c-b9e2-33d5d11b2aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef80a669-e7ef-4a1c-b9e2-33d5d11b2aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1affa16-b802-4718-89d9-d1fb4bcb86ee', 'volume_name': 'volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e12613-04c9-4ec1-aea3-602c30123c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e12613-04c9-4ec1-aea3-602c30123c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f1000e-e667-4432-9c0c-f50575c674a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:42 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume b1affa16-b802-4718-89d9-d1fb4bcb86ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee', 'volume_size': 1}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (af94e9f1-5253-409f-b8ee-63a5a84025ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2ec219-2238-4d0c-99ee-1e1397218784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2ec219-2238-4d0c-99ee-1e1397218784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002151159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76016f0-b146-4652-857b-c9256f4b5d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:43Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb6cbfb-3f45-400f-90fe-3074d3c6befc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb6cbfb-3f45-400f-90fe-3074d3c6befc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f9c422-936e-4813-b1f8-427cc268c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f9c422-936e-4813-b1f8-427cc268c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76016f0-b146-4652-857b-c9256f4b5d92', 'volume_name': 'volume-d76016f0-b146-4652-857b-c9256f4b5d92', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4657696-0018-436d-8549-ed54419ae363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4657696-0018-436d-8549-ed54419ae363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff1b76e-2ed1-4abd-8a44-b4bb194297f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume d76016f0-b146-4652-857b-c9256f4b5d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76016f0-b146-4652-857b-c9256f4b5d92', 'volume_size': 1}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (d7199cff-fad7-4356-b54d-f68b81258c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c72be7-d49f-4a45-9431-8e005cd01f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c72be7-d49f-4a45-9431-8e005cd01f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1923771082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbede9fb-b8af-42a7-a8a2-3ed9016d5c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:43Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47539ce9-444a-4ebf-8b9d-390d361e8d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47539ce9-444a-4ebf-8b9d-390d361e8d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3787c81-003c-4ec4-a53d-1a497000b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3787c81-003c-4ec4-a53d-1a497000b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbede9fb-b8af-42a7-a8a2-3ed9016d5c96', 'volume_name': 'volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733e368e-1723-4430-ad26-7c608e4f0346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733e368e-1723-4430-ad26-7c608e4f0346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475e4265-f189-40b1-b9bc-a2e77542ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:43 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume fbede9fb-b8af-42a7-a8a2-3ed9016d5c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96', 'volume_size': 1}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:43 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 1.428s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:43 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 is being set with open permissions: ugo+rw
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:43 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:43 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:43 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.708s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.451s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132972964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ce642e-4b8d-488c-9774-8db73a42f6ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:41Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating volume 10ce642e-4b8d-488c-9774-8db73a42f6ef {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:43 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f4516edc-71f9-4dfc-927b-d41a4f4f8d66 tempest-VolumesSnapshotListTestJSON-725121273 None] Create snapshot completed successfully
Apr 20 18:43:43 devstack sudo[88576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef 1073741824
Apr 20 18:43:43 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:44 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef 1073741824" returned: 0 in 0.901s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:44 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef
Apr 20 18:43:44 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:45 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef" returned: 0 in 0.567s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1277428566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a47c4c-04fc-4f10-8a70-74afb4ba5690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:42Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating volume 73a47c4c-04fc-4f10-8a70-74afb4ba5690 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:45 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:45 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 1073741824
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37f97e2-d225-4386-890e-e4552f255da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ce642e-4b8d-488c-9774-8db73a42f6ef', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:45 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3138986-8fd5-4d4d-bd6f-7d8759e5d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:45 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume volume-10ce642e-4b8d-488c-9774-8db73a42f6ef (10ce642e-4b8d-488c-9774-8db73a42f6ef): created successfully
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3138986-8fd5-4d4d-bd6f-7d8759e5d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (eeb1b890-109b-4434-902c-4eed9d420da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:45 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b434ad60-5a4a-442c-bab6-528cdc403b45 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created volume successfully.
Apr 20 18:43:46 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 1073741824" returned: 0 in 0.638s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:46 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690
Apr 20 18:43:46 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:46 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690" returned: 0 in 0.614s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.275s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374836085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1affa16-b802-4718-89d9-d1fb4bcb86ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:42Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating volume b1affa16-b802-4718-89d9-d1fb4bcb86ee {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:46 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b87e23-2f92-45a1-a135-11381e3dfcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c141a03-cf91-4587-961a-70fcf50649d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:46 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 (73a47c4c-04fc-4f10-8a70-74afb4ba5690): created successfully
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c141a03-cf91-4587-961a-70fcf50649d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (483a94da-be69-49f4-b41c-aa8d37f02757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:46 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee 1073741824
Apr 20 18:43:46 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:46 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-becc6e00-a2c4-4c10-8e8d-9a87d19e84a7 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created volume successfully.
Apr 20 18:43:47 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee 1073741824" returned: 0 in 0.575s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:47 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee
Apr 20 18:43:47 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:47 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee" returned: 0 in 0.674s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.896s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2002151159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76016f0-b146-4652-857b-c9256f4b5d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:43Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating volume d76016f0-b146-4652-857b-c9256f4b5d92 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:47 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f1000e-e667-4432-9c0c-f50575c674a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dfdadc-6dd8-4839-89cf-2078cfce893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee (b1affa16-b802-4718-89d9-d1fb4bcb86ee): created successfully
Apr 20 18:43:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4dfdadc-6dd8-4839-89cf-2078cfce893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:48 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92 1073741824
Apr 20 18:43:48 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (95147360-259f-4226-b5c6-ddb4b4c22469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:48 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-9cf7bfab-275a-45b4-b232-d654025682ba tempest-CreateVolumesFromSnapshotTest-528178686 None] Created volume successfully.
Apr 20 18:43:48 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92 1073741824" returned: 0 in 0.617s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:48 devstack sudo[88655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92
Apr 20 18:43:48 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:49 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92" returned: 0 in 0.607s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.020s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1923771082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbede9fb-b8af-42a7-a8a2-3ed9016d5c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c64686d4614a7c84f590b989a54ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:43Z,use_quota=True,user_id='1648f4de08684209b17b638b762022c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Creating volume fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:49 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff1b76e-2ed1-4abd-8a44-b4bb194297f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76016f0-b146-4652-857b-c9256f4b5d92', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f96a13-17e9-40f0-85e5-f3affe566e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:49 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume volume-d76016f0-b146-4652-857b-c9256f4b5d92 (d76016f0-b146-4652-857b-c9256f4b5d92): created successfully
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f96a13-17e9-40f0-85e5-f3affe566e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (af94e9f1-5253-409f-b8ee-63a5a84025ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:49 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 1073741824
Apr 20 18:43:49 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:49 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-73b0bf6e-93da-4a86-b244-ddc12562d853 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created volume successfully.
Apr 20 18:43:49 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 1073741824" returned: 0 in 0.608s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:49 devstack sudo[88663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96
Apr 20 18:43:49 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:50 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96" returned: 0 in 0.483s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.825s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475e4265-f189-40b1-b9bc-a2e77542ee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bdd9ff-4be4-43a4-942e-93e549c28b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:50 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Volume volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 (fbede9fb-b8af-42a7-a8a2-3ed9016d5c96): created successfully
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bdd9ff-4be4-43a4-942e-93e549c28b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Flow 'volume_create_manager' (d7199cff-fad7-4356-b54d-f68b81258c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Creating offline snapshot 5e7cd1f9-2352-41cd-b959-9892d8e4764d of volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:43:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-df3f8287-431c-4224-adf8-fb224313914f tempest-CreateVolumesFromSnapshotTest-528178686 None] Created volume successfully.
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed87d1e-6cc0-490e-9960-dacfca8521b7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:50 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:50 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:51 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 0.640s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:51 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d 1G
Apr 20 18:43:51 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96" acquired by "delete_volume" :: waited 0.083s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fb7431-e885-4611-bbee-3f0ae14c746b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:51 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96
Apr 20 18:43:51 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Flow 'volume_create_manager' (05b651cd-1335-492a-9aa6-c577d8216e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57091e11-1b6d-4980-8dd7-1118de479f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57091e11-1b6d-4980-8dd7-1118de479f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-812827824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56e198a-4ab3-4e76-af28-102e77caad6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6cc5763ca344f5aa808391c2b83bc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:52Z,use_quota=True,user_id='8ddd7356dfc24ccda19358b79d0f5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d077cb43-bcf3-4057-8fd2-517b145b878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d077cb43-bcf3-4057-8fd2-517b145b878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:51 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15a5b49-a85b-47f3-b381-98be4688a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15a5b49-a85b-47f3-b381-98be4688a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56e198a-4ab3-4e76-af28-102e77caad6b', 'volume_name': 'volume-b56e198a-4ab3-4e76-af28-102e77caad6b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb5016b-100d-4dfe-8721-cf12d6305d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb5016b-100d-4dfe-8721-cf12d6305d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81f3a3a-e529-4eb9-ad42-2aa77dfcf7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Volume b56e198a-4ab3-4e76-af28-102e77caad6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56e198a-4ab3-4e76-af28-102e77caad6b', 'volume_size': 1}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96" returned: 0 in 0.768s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:52 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96
Apr 20 18:43:52 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:52 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d 1G" returned: 0 in 1.031s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:52 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d
Apr 20 18:43:52 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Flow 'volume_create_manager' (d3329bfd-ca2a-43d8-8b62-f6cf32542ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9c41d7-c3a5-4685-a113-568c9a141266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9c41d7-c3a5-4685-a113-568c9a141266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1516201915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3080240-7e2d-4260-a14c-1aebeb892323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9917fb59a9bd42b1975ea7769fdb4821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:52Z,use_quota=True,user_id='7d151e2622fa472b9683c7d235cd9cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1cb2f1-bdc1-4f2e-b7fc-f410fe800a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1cb2f1-bdc1-4f2e-b7fc-f410fe800a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2ebf72-6232-4bb7-ae9a-1738fa94d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2ebf72-6232-4bb7-ae9a-1738fa94d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3080240-7e2d-4260-a14c-1aebeb892323', 'volume_name': 'volume-f3080240-7e2d-4260-a14c-1aebeb892323', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25e6e53-0056-440e-9908-aa123ba00a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25e6e53-0056-440e-9908-aa123ba00a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce87aaf2-a851-4608-abb8-a0bf11a820be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:52 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Volume f3080240-7e2d-4260-a14c-1aebeb892323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3080240-7e2d-4260-a14c-1aebeb892323', 'volume_size': 1}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:52 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96" released by "delete_volume" :: held 1.291s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['7d4f1779-827f-45a4-99f7-9393ebdc4e14', '0918c1dc-fd51-4b54-94d7-8543a43ef85c', '7d9fa213-5299-4bc0-9455-fa458d742055', '9307be9a-e630-4d78-8b8e-5a69fe7a0473'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:52 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:52 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:52 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d" returned: 0 in 0.514s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:52 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d is being set with open permissions: ugo+rw
Apr 20 18:43:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:52 devstack sudo[88692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d
Apr 20 18:43:52 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:53 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.434s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleted volume successfully.
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-9ade1de5-de60-4901-935a-9f075b9c886c tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-fbede9fb-b8af-42a7-a8a2-3ed9016d5c96-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:53 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d" returned: 0 in 0.452s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-812827824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56e198a-4ab3-4e76-af28-102e77caad6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6cc5763ca344f5aa808391c2b83bc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:52Z,use_quota=True,user_id='8ddd7356dfc24ccda19358b79d0f5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Creating volume b56e198a-4ab3-4e76-af28-102e77caad6b {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:53 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:53 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b 1073741824
Apr 20 18:43:53 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ea9b3fca-5572-4a7e-a55a-613778b1bf16 tempest-VolumesSnapshotListTestJSON-725121273 None] Create snapshot completed successfully
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-d76016f0-b146-4652-857b-c9256f4b5d92-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-d76016f0-b146-4652-857b-c9256f4b5d92-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-d76016f0-b146-4652-857b-c9256f4b5d92" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-d76016f0-b146-4652-857b-c9256f4b5d92" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bc86d-87d8-4055-8a3c-805674779f11]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:53 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92
Apr 20 18:43:53 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:53 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b 1073741824" returned: 0 in 0.511s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:53 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b
Apr 20 18:43:53 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:53 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92" returned: 0 in 0.550s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:53 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92
Apr 20 18:43:53 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:54 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b" returned: 0 in 0.425s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1516201915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3080240-7e2d-4260-a14c-1aebeb892323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9917fb59a9bd42b1975ea7769fdb4821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:52Z,use_quota=True,user_id='7d151e2622fa472b9683c7d235cd9cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Creating volume f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:54 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:54 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 1073741824
Apr 20 18:43:54 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81f3a3a-e529-4eb9-ad42-2aa77dfcf7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56e198a-4ab3-4e76-af28-102e77caad6b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2a3bdc-f9c3-4f9c-9c63-8761257ce3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:54 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Volume volume-b56e198a-4ab3-4e76-af28-102e77caad6b (b56e198a-4ab3-4e76-af28-102e77caad6b): created successfully
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2a3bdc-f9c3-4f9c-9c63-8761257ce3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Flow 'volume_create_manager' (05b651cd-1335-492a-9aa6-c577d8216e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:54 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7bd46007-d97d-4e9d-9843-4699c0d86949 tempest-ServersNegativeTestJSON-1490161317 None] Created volume successfully.
Apr 20 18:43:54 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d76016f0-b146-4652-857b-c9256f4b5d92" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-d76016f0-b146-4652-857b-c9256f4b5d92" released by "delete_volume" :: held 1.138s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['a05d5aa6-4d71-4ee0-9dfb-b80981d2219b', 'aec1b5cb-839d-483f-a5b9-3cfe2ee86d6f', '708ee609-b708-41a1-8897-0543925b8015', '2f5f04e2-daf8-417f-8dbd-dce87f92696a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:54 devstack sudo[88714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:54 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:54 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 1073741824" returned: 0 in 0.650s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:54 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:43:54 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-5e7cd1f9-2352-41cd-b959-9892d8e4764d-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-5e7cd1f9-2352-41cd-b959-9892d8e4764d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-5e7cd1f9-2352-41cd-b959-9892d8e4764d" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-5e7cd1f9-2352-41cd-b959-9892d8e4764d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Deleting offline snapshot 5e7cd1f9-2352-41cd-b959-9892d8e4764d of volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] snapshot_file for this snap is: volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996a09a-5ec0-4053-9e51-f34ed75b1043]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:55 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.548s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleted volume successfully.
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-60c08251-0ee6-4d54-b67a-d98eb923819d tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-d76016f0-b146-4652-857b-c9256f4b5d92-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:55 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d
Apr 20 18:43:55 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:55 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.599s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce87aaf2-a851-4608-abb8-a0bf11a820be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3080240-7e2d-4260-a14c-1aebeb892323', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67d7eec-fabf-4fbe-b9cb-ad4325995312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Volume volume-f3080240-7e2d-4260-a14c-1aebeb892323 (f3080240-7e2d-4260-a14c-1aebeb892323): created successfully
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67d7eec-fabf-4fbe-b9cb-ad4325995312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Flow 'volume_create_manager' (d3329bfd-ca2a-43d8-8b62-f6cf32542ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c657e8a8-5d90-477b-9894-10bca2bafce6 tempest-SnapshotDependencyTests-1977696549 None] Created volume successfully.
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-b1affa16-b802-4718-89d9-d1fb4bcb86ee-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-b1affa16-b802-4718-89d9-d1fb4bcb86ee-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-b1affa16-b802-4718-89d9-d1fb4bcb86ee" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-b1affa16-b802-4718-89d9-d1fb4bcb86ee" acquired by "delete_volume" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f730b-cdaf-4988-a50a-310fbbf344ed]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:55 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d" returned: 0 in 0.647s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da6004-71e8-4601-ace8-9a2e0ae654e5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:55 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee
Apr 20 18:43:55 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:55 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:55 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Flow 'volume_create_manager' (0d46ad56-f98e-4e7c-aeb1-18f5f20ccb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a14099e-4d7b-4a92-b84c-99a600b75a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a14099e-4d7b-4a92-b84c-99a600b75a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1222256183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd57dde7-6b07-476a-a4d4-d7ee10f51635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6cc5763ca344f5aa808391c2b83bc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:56Z,use_quota=True,user_id='8ddd7356dfc24ccda19358b79d0f5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9310077-a18d-46bd-a5a5-5340f454378a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9310077-a18d-46bd-a5a5-5340f454378a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8e9ea8-8d88-402c-9287-03f71cf34736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8e9ea8-8d88-402c-9287-03f71cf34736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd57dde7-6b07-476a-a4d4-d7ee10f51635', 'volume_name': 'volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e98875c-e9a2-45bf-afa8-083e29aa99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e98875c-e9a2-45bf-afa8-083e29aa99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad44988d-92a3-4759-bd55-93a86397e445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:56 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Volume bd57dde7-6b07-476a-a4d4-d7ee10f51635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635', 'volume_size': 1}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1222256183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd57dde7-6b07-476a-a4d4-d7ee10f51635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6cc5763ca344f5aa808391c2b83bc69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:43:56Z,use_quota=True,user_id='8ddd7356dfc24ccda19358b79d0f5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Creating volume bd57dde7-6b07-476a-a4d4-d7ee10f51635 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:43:56 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:56 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 1073741824
Apr 20 18:43:56 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:56 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee" returned: 0 in 0.559s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:56 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 0.508s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:56 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee
Apr 20 18:43:56 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:56 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d
Apr 20 18:43:56 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:56 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b1affa16-b802-4718-89d9-d1fb4bcb86ee" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-b1affa16-b802-4718-89d9-d1fb4bcb86ee" released by "delete_volume" :: held 1.015s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['1c4d8290-d428-4d83-bcd5-611c344671d6', '1ead61e3-d3ab-4324-99b8-529ef98f94da', '2c3af833-6b0d-4659-b804-7d2dc1a351a7', '88fa5b11-9039-46ca-9f23-02961a7fe758'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:56 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 1073741824" returned: 0 in 0.561s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:56 devstack sudo[88750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635
Apr 20 18:43:56 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:56 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:56 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:56 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d" returned: 0 in 0.674s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:56 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d
Apr 20 18:43:56 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:57 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleted volume successfully.
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5563c044-1eeb-45f4-8a06-ef0f444e3375 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-b1affa16-b802-4718-89d9-d1fb4bcb86ee-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:57 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635" returned: 0 in 0.606s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.493s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad44988d-92a3-4759-bd55-93a86397e445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c18c965-bfaf-4416-9aa8-c5331db0b1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:43:57 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Volume volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 (bd57dde7-6b07-476a-a4d4-d7ee10f51635): created successfully
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c18c965-bfaf-4416-9aa8-c5331db0b1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Flow 'volume_create_manager' (0d46ad56-f98e-4e7c-aeb1-18f5f20ccb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Creating offline snapshot 5b49c7aa-f549-459f-9f7d-35962b83682f of volume f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98c3491-5da6-405e-8baa-6a9968b4defc]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-14406bb0-3caf-4f5f-b42f-127d13ba443f tempest-ServersNegativeTestJSON-1490161317 None] Created volume successfully.
Apr 20 18:43:57 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.5e7cd1f9-2352-41cd-b959-9892d8e4764d" returned: 0 in 0.504s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-5e7cd1f9-2352-41cd-b959-9892d8e4764d" released by "_delete_snapshot" :: held 2.403s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" released by "delete_snapshot" :: held 2.437s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:57 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:43:57 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Created reservations ['35b7e5ac-054f-4256-a31d-4a60b6873037', '74064493-b5d8-485a-80cb-a0317ae9b738', 'acda12d9-ba60-41d8-b9d2-6bfc8cfc074c', 'a18843d8-f9d2-417e-a709-b33340effb93'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:57 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Delete snapshot completed successfully.
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-55ec4fee-1733-4a3b-baee-f9feed5dca51 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-5e7cd1f9-2352-41cd-b959-9892d8e4764d-delete_snapshot" released by "delete_snapshot" :: held 2.529s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-73a47c4c-04fc-4f10-8a70-74afb4ba5690-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-73a47c4c-04fc-4f10-8a70-74afb4ba5690-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-73a47c4c-04fc-4f10-8a70-74afb4ba5690" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-73a47c4c-04fc-4f10-8a70-74afb4ba5690" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a3132c-dac9-4b91-9156-fbf166dd2823]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:57 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690
Apr 20 18:43:57 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:57 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:57 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f 1G
Apr 20 18:43:57 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-6f0d9c74-92dc-46a5-86f0-2917b35dda84-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-6f0d9c74-92dc-46a5-86f0-2917b35dda84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-6f0d9c74-92dc-46a5-86f0-2917b35dda84" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-6f0d9c74-92dc-46a5-86f0-2917b35dda84" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Deleting offline snapshot 6f0d9c74-92dc-46a5-86f0-2917b35dda84 of volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] snapshot_file for this snap is: volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86e787-ed85-463b-a8bb-055d3a9500ed]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:58 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690" returned: 0 in 0.546s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690
Apr 20 18:43:58 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f 1G" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3080240-7e2d-4260-a14c-1aebeb892323 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3080240-7e2d-4260-a14c-1aebeb892323 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f
Apr 20 18:43:58 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "cinder-bd57dde7-6b07-476a-a4d4-d7ee10f51635-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-bd57dde7-6b07-476a-a4d4-d7ee10f51635-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=206,cinder:SELECT=144,cinder:DELETE=21,cinder:INSERT=48 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=150,cinder:INSERT=46,cinder:UPDATE=196,cinder:DELETE=19 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "cinder-quobyte-bd57dde7-6b07-476a-a4d4-d7ee10f51635" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-quobyte-bd57dde7-6b07-476a-a4d4-d7ee10f51635" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176f15d-7827-480a-9f68-1422778f32f4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635
Apr 20 18:43:58 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 0.531s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[418d50ad-938b-4293-8594-e8edfc5c43f9]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-73a47c4c-04fc-4f10-8a70-74afb4ba5690" returned: 0 in 0.442s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-73a47c4c-04fc-4f10-8a70-74afb4ba5690" released by "delete_volume" :: held 1.013s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:58 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:43:58 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['70c12b9b-848b-4ec3-8d1e-0df53edd5594', '0bb02978-c7d8-4a04-aaa4-2f60e291f3b1', '59c16939-1ff6-45fa-b52d-36badbecaeb6', '3374f9fc-5e3b-46dd-bab9-f2bf4e9835e4'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3080240-7e2d-4260-a14c-1aebeb892323 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:58 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f is being set with open permissions: ugo+rw
Apr 20 18:43:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:58 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:58 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:58 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f
Apr 20 18:43:58 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:59 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635
Apr 20 18:43:59 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.513s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:59 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:59 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.438s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:43:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleted volume successfully.
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8b86b163-f5b7-4566-a68a-24a08a4aaa73 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-73a47c4c-04fc-4f10-8a70-74afb4ba5690-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:59 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f" returned: 0 in 0.444s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:59 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info
Apr 20 18:43:59 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-bd57dde7-6b07-476a-a4d4-d7ee10f51635" returned: 0 in 0.444s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-quobyte-bd57dde7-6b07-476a-a4d4-d7ee10f51635" released by "delete_volume" :: held 1.006s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Created reservations ['4495bf52-223b-47b2-ad65-f9983ae94b53', '9a51f449-7930-4eb8-8904-9973be892548', 'ff3846eb-d41f-4963-b46a-795633c8e7b5', '62f67b58-c777-422b-88c0-afae8474e5f7'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:59 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:43:59 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 0.503s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:59 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84
Apr 20 18:43:59 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info" returned: 0 in 0.443s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:43:59 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info is being set with open permissions: ugo+rw
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:43:59 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info
Apr 20 18:43:59 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-10ce642e-4b8d-488c-9774-8db73a42f6ef-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-10ce642e-4b8d-488c-9774-8db73a42f6ef-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-10ce642e-4b8d-488c-9774-8db73a42f6ef" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:43:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-10ce642e-4b8d-488c-9774-8db73a42f6ef" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[361743ac-499e-462d-a66e-e72e89c36179]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:00 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef
Apr 20 18:44:00 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:00 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:00 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Deleted volume successfully.
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.6f0d9c74-92dc-46a5-86f0-2917b35dda84" returned: 0 in 0.420s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-6f0d9c74-92dc-46a5-86f0-2917b35dda84" released by "_delete_snapshot" :: held 2.015s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cec9eb87-064f-4ef0-bc8e-ad64a5267904 tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-bd57dde7-6b07-476a-a4d4-d7ee10f51635-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" released by "delete_snapshot" :: held 2.028s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Created reservations ['9461dc59-fdeb-408d-88ad-9681fbecd685', '4e62237d-90ed-4e25-a9ae-ca6309527726', '2475f63b-cbcf-41a2-8fc6-898fa2389e5f', '9cf7ba47-740f-4ae4-9a82-fefa2998e694'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Delete snapshot completed successfully.
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2e411ebd-4b40-4eae-981d-4b92aeff5856 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-6f0d9c74-92dc-46a5-86f0-2917b35dda84-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-0f3ad857-df98-4391-a2b8-93ee327a0d74-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-0f3ad857-df98-4391-a2b8-93ee327a0d74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:00 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.info" returned: 0 in 0.480s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-0f3ad857-df98-4391-a2b8-93ee327a0d74" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-bfe05396-37a5-4100-8053-b3dd907f8528 tempest-SnapshotDependencyTests-1977696549 None] Create snapshot completed successfully
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-0f3ad857-df98-4391-a2b8-93ee327a0d74" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Deleting offline snapshot 0f3ad857-df98-4391-a2b8-93ee327a0d74 of volume cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] snapshot_file for this snap is: volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc16d5-4a33-4186-b7a1-be36f7839327]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:00 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:44:00 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:00 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef" returned: 0 in 0.542s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:00 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef
Apr 20 18:44:00 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "cinder-b56e198a-4ab3-4e76-af28-102e77caad6b-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-b56e198a-4ab3-4e76-af28-102e77caad6b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "cinder-quobyte-b56e198a-4ab3-4e76-af28-102e77caad6b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-quobyte-b56e198a-4ab3-4e76-af28-102e77caad6b" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039cda8-161d-4f10-81c6-2d975b8a408b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:00 devstack sudo[88834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b
Apr 20 18:44:00 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:00 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.536s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[751c9779-e094-4e3a-838f-e41037773200]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:00 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3
Apr 20 18:44:00 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:01 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-10ce642e-4b8d-488c-9774-8db73a42f6ef" returned: 0 in 0.457s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-10ce642e-4b8d-488c-9774-8db73a42f6ef" released by "delete_volume" :: held 1.038s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['d9ba3613-eaae-4978-a98c-2b855dd5b75a', '9df704a2-12bd-4003-ac24-448ff2eb8977', '957406b5-2676-430c-b6be-cb320fe74d0b', '4c912dc9-dc81-4b4e-a852-b297aff02f1a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:01 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:01 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:01 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b" returned: 0 in 0.519s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:01 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b
Apr 20 18:44:01 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Flow 'volume_create_manager' (0d8361ca-a853-421e-86a4-a958da090b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8a83fb-5a10-4fd1-b7ac-0382dc3ae367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8a83fb-5a10-4fd1-b7ac-0382dc3ae367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913bdacb-05fd-43df-886f-efca95cbc76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9917fb59a9bd42b1975ea7769fdb4821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b49c7aa-f549-459f-9f7d-35962b83682f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:01Z,use_quota=True,user_id='7d151e2622fa472b9683c7d235cd9cb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4db5889-edad-4ebc-8fdb-9941b98b6616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4db5889-edad-4ebc-8fdb-9941b98b6616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cbab4c-88d9-4cfa-8d68-436b84d9b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cbab4c-88d9-4cfa-8d68-436b84d9b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '913bdacb-05fd-43df-886f-efca95cbc76a', 'volume_name': 'volume-913bdacb-05fd-43df-886f-efca95cbc76a', 'volume_size': 1, 'snapshot_id': '5b49c7aa-f549-459f-9f7d-35962b83682f'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8d988e-3b17-4410-b06a-f06de2f52bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8d988e-3b17-4410-b06a-f06de2f52bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a9cb9a-c8c7-4527-920a-bc9ec8cea443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:01 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Volume 913bdacb-05fd-43df-886f-efca95cbc76a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-913bdacb-05fd-43df-886f-efca95cbc76a', 'volume_size': 1, 'snapshot_id': '5b49c7aa-f549-459f-9f7d-35962b83682f'}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-quobyte-5b49c7aa-f549-459f-9f7d-35962b83682f-913bdacb-05fd-43df-886f-efca95cbc76a" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-5b49c7aa-f549-459f-9f7d-35962b83682f-913bdacb-05fd-43df-886f-efca95cbc76a" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Creating volume 913bdacb-05fd-43df-886f-efca95cbc76a from snapshot 5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:01 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-quobyte-913bdacb-05fd-43df-886f-efca95cbc76a" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" returned: 0 in 0.594s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-913bdacb-05fd-43df-886f-efca95cbc76a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] snapshot: 5b49c7aa-f549-459f-9f7d-35962b83682f, volume: 913bdacb-05fd-43df-886f-efca95cbc76a,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:44:01 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:44:01 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7aa547-39d9-4d66-8af7-1f2326d10f13]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:01 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.444s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleted volume successfully.
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6997f206-0707-40eb-8132-abd095c133d2 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-10ce642e-4b8d-488c-9774-8db73a42f6ef-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:01 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f
Apr 20 18:44:01 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:01 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b56e198a-4ab3-4e76-af28-102e77caad6b" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-quobyte-b56e198a-4ab3-4e76-af28-102e77caad6b" released by "delete_volume" :: held 1.000s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Created reservations ['9738c2e7-3f3e-47dd-9216-6e25febc578d', 'e5f9139d-254b-49d4-a893-0650d69f1a25', '0f12b709-68a4-41aa-b885-a8c32bb6dc16', '00ef6117-4626-4447-81cc-838c6aa2eaeb'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:01 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:01 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:01 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:01 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74
Apr 20 18:44:01 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:02 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f" returned: 0 in 0.530s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3080240-7e2d-4260-a14c-1aebeb892323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c5d4ae-318c-4c9e-91fa-22fe1a6c0424]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:02 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:44:02 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-9d5c5b2f-a831-4083-b8ea-c87e18b8dff1-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-9d5c5b2f-a831-4083-b8ea-c87e18b8dff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-858155c8-8e26-47bd-9ecb-de239175bf0a" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-858155c8-8e26-47bd-9ecb-de239175bf0a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleting offline snapshot 9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 of volume 858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] snapshot_file for this snap is: volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0bb1d-6ae1-4d6d-836b-78267221331f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:02 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.438s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Deleted volume successfully.
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6028b4ca-bb55-46d9-8bef-3f82f9d6e84a tempest-ServersNegativeTestJSON-1490161317 None] Lock "cinder-b56e198a-4ab3-4e76-af28-102e77caad6b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:02 devstack sudo[88871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1
Apr 20 18:44:02 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:02 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3.0f3ad857-df98-4391-a2b8-93ee327a0d74" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:02 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:02 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-0f3ad857-df98-4391-a2b8-93ee327a0d74" released by "_delete_snapshot" :: held 2.117s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" released by "delete_snapshot" :: held 2.142s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Created reservations ['ecef4f5e-6d13-4d33-9226-d86f06b98aa7', '0dc6ffef-5d67-4dd9-946a-df5e90792a20', '578f8a24-abcf-493a-bcc8-bba093383533', '91566fba-3f6f-4141-a8f0-26dad4ecf638'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Delete snapshot completed successfully.
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dae295c0-5842-487a-8a63-1870f0c29f18 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-0f3ad857-df98-4391-a2b8-93ee327a0d74-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:02 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.533s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:02 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a
Apr 20 18:44:02 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:02 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" returned: 0 in 0.512s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-858155c8-8e26-47bd-9ecb-de239175bf0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f8dff-cbf6-4ef4-9d1c-2439a5fde532]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:02 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a
Apr 20 18:44:02 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:02 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.485s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:03 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a" returned: 0 in 0.742s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:03 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1
Apr 20 18:44:03 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[468c77f8-1834-4813-8f3a-e631a43c3240]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:04 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3
Apr 20 18:44:04 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:05 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" returned: 0 in 1.679s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:05 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1
Apr 20 18:44:05 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:05 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a" returned: 0 in 2.871s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa60531-07c7-416d-ad58-391a330d91ab]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:05 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:44:05 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:05 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" returned: 0 in 1.482s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:05 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3
Apr 20 18:44:05 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:05 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a.9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" returned: 0 in 0.770s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-9d5c5b2f-a831-4083-b8ea-c87e18b8dff1" released by "_delete_snapshot" :: held 3.757s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-858155c8-8e26-47bd-9ecb-de239175bf0a" released by "delete_snapshot" :: held 3.769s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:05 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['31fa5bc9-2a33-4160-947b-0b4449656391', '44fd58a5-3170-4625-a206-1bdcc989115f', '4a6172bf-a635-4cb8-8dfa-df76c3ec632e', '9e0bc059-987d-46b0-938c-cb33aa10620f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Delete snapshot completed successfully.
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3087a00a-73ef-42dd-8de1-49eecc43e585 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-9d5c5b2f-a831-4083-b8ea-c87e18b8dff1-delete_snapshot" released by "delete_snapshot" :: held 3.852s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:06 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" returned: 0 in 0.538s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-quobyte-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3" released by "delete_volume" :: held 2.085s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Created reservations ['b4f4a9e5-7106-414b-9fdd-cd9b2feb8ac2', '348dcd5c-fd29-4541-a324-d20e2b3fbcfc', '9553b131-9146-46fb-a579-cb9367d5353d', 'ebc3f966-e9da-42b9-993d-2ff87b697642'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:06 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.729s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323, size 1024.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:44:06 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Converted 1024.00 MB image at 356.47 MB/s
Apr 20 18:44:06 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a is being set with open permissions: ugo+rw
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:06 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a
Apr 20 18:44:06 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:06 devstack sudo[88955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:06 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-858155c8-8e26-47bd-9ecb-de239175bf0a-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-858155c8-8e26-47bd-9ecb-de239175bf0a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "cinder-quobyte-858155c8-8e26-47bd-9ecb-de239175bf0a" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-858155c8-8e26-47bd-9ecb-de239175bf0a" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4011397-4d37-4e44-b159-96093c028673]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:06 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a
Apr 20 18:44:06 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:06 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a" returned: 0 in 0.513s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-913bdacb-05fd-43df-886f-efca95cbc76a" released by "_copy_volume_from_snapshot" :: held 5.240s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-5b49c7aa-f549-459f-9f7d-35962b83682f-913bdacb-05fd-43df-886f-efca95cbc76a" released by "_create_volume_from_snapshot" :: held 5.269s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.277s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a9cb9a-c8c7-4527-920a-bc9ec8cea443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913bdacb-05fd-43df-886f-efca95cbc76a', 'volume_size': 1, 'snapshot_id': '5b49c7aa-f549-459f-9f7d-35962b83682f'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3011b4d5-061d-42cc-b2b3-922f8e82eee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:06 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Volume volume-913bdacb-05fd-43df-886f-efca95cbc76a (913bdacb-05fd-43df-886f-efca95cbc76a): created successfully
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3011b4d5-061d-42cc-b2b3-922f8e82eee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Flow 'volume_create_manager' (0d8361ca-a853-421e-86a4-a958da090b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-711450a2-a290-4f2a-9282-deaa67a74cc6 tempest-SnapshotDependencyTests-1977696549 None] Created volume successfully.
Apr 20 18:44:06 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.626s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Deleted volume successfully.
Apr 20 18:44:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6978b70c-c3bd-4db0-aa6d-ce20fb56a8e1 tempest-VolumesSnapshotListTestJSON-725121273 None] Lock "cinder-cdfaec9d-128c-4c8a-bd23-f62ca2bf9bc3-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:07 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a" returned: 0 in 0.570s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:07 devstack sudo[88964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a
Apr 20 18:44:07 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:07 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-858155c8-8e26-47bd-9ecb-de239175bf0a" returned: 0 in 0.441s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-quobyte-858155c8-8e26-47bd-9ecb-de239175bf0a" released by "delete_volume" :: held 1.060s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Created reservations ['8af26624-9c8e-4a28-acba-052793105c60', '91ab7ca1-d215-4b65-8d4c-1a2526bd897a', 'f4cf4d6e-f9fc-4290-81dd-d1d3bebee4a9', 'a4a5f112-4812-4ceb-9a36-7989ffc1dc5b'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:07 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:07 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-5b49c7aa-f549-459f-9f7d-35962b83682f-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-5b49c7aa-f549-459f-9f7d-35962b83682f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-quobyte-f3080240-7e2d-4260-a14c-1aebeb892323" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-f3080240-7e2d-4260-a14c-1aebeb892323" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-quobyte-5b49c7aa-f549-459f-9f7d-35962b83682f" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-5b49c7aa-f549-459f-9f7d-35962b83682f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Deleting offline snapshot 5b49c7aa-f549-459f-9f7d-35962b83682f of volume f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:44:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] snapshot_file for this snap is: volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad3a3a1-3072-4ad6-9acf-f8526cc3a388]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:08 devstack sudo[88969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f
Apr 20 18:44:08 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (d4134781-e4b6-4013-87ea-075f576b1c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5846dc4-84d5-4b5c-aa1b-bb7dfd73c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5846dc4-84d5-4b5c-aa1b-bb7dfd73c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492392564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:08Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7e5c4-7c79-4df0-aab2-fb8d8eac8f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7e5c4-7c79-4df0-aab2-fb8d8eac8f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aec510-cec8-4a5b-93b8-c81bd1837325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78aec510-cec8-4a5b-93b8-c81bd1837325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece', 'volume_name': 'volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a9299e-94e5-4e5a-b986-a36510f801e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a9299e-94e5-4e5a-b986-a36510f801e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad633a5-7c7b-4263-a1fc-8a7d1d7c75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Volume 1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece', 'volume_size': 1}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-492392564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:08Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Creating volume 1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:08 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:08 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.498s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Deleted volume successfully.
Apr 20 18:44:08 devstack sudo[88972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece 1073741824
Apr 20 18:44:08 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-29b8921e-27a0-40a7-b909-07d94b256e23 tempest-CreateVolumesFromSnapshotTest-528178686 None] Lock "cinder-858155c8-8e26-47bd-9ecb-de239175bf0a-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (1e6f9ad0-a14d-4763-ba7b-2b7b0c8822dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96632dc-a776-4d7c-8db0-c8ea19a34027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96632dc-a776-4d7c-8db0-c8ea19a34027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1334975647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba62ab2-2476-407d-8dd0-324f63ec3308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:08Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f45fcd-4311-485b-9dba-038ded2531b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f45fcd-4311-485b-9dba-038ded2531b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a01a5ad-8b23-4df0-ab27-380ebb0161af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a01a5ad-8b23-4df0-ab27-380ebb0161af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba62ab2-2476-407d-8dd0-324f63ec3308', 'volume_name': 'volume-cba62ab2-2476-407d-8dd0-324f63ec3308', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa06710-3864-4329-af3d-7b3d96eca319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa06710-3864-4329-af3d-7b3d96eca319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5bc4d53-af97-4d0b-86bf-1631c92669a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Volume cba62ab2-2476-407d-8dd0-324f63ec3308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba62ab2-2476-407d-8dd0-324f63ec3308', 'volume_size': 1}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (11b8cdab-6cc0-495d-b885-751e44f6e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f0924c-a5ea-41d9-af98-7873c4579b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f0924c-a5ea-41d9-af98-7873c4579b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-162209889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92811d9f-82ca-4480-b670-407079e5567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:08Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4871e9a-c24a-4c45-aad4-431f027fec08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4871e9a-c24a-4c45-aad4-431f027fec08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f87e42f-2661-4b21-aa1f-b45f7773f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f87e42f-2661-4b21-aa1f-b45f7773f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92811d9f-82ca-4480-b670-407079e5567a', 'volume_name': 'volume-92811d9f-82ca-4480-b670-407079e5567a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fb5d9e-db12-4f4a-8012-a1c97bb321bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5fb5d9e-db12-4f4a-8012-a1c97bb321bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae9e929-3765-4f27-8360-113e213385ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Volume 92811d9f-82ca-4480-b670-407079e5567a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92811d9f-82ca-4480-b670-407079e5567a', 'volume_size': 1}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:08 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f" returned: 0 in 0.589s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3080240-7e2d-4260-a14c-1aebeb892323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf84b86-e093-4039-a895-a56af6044278]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:08 devstack sudo[88977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:44:08 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (66125973-0607-4782-a240-f9aa84516592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e3bdbc-f109-460c-b608-455d516c7ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e3bdbc-f109-460c-b608-455d516c7ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989658950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f428a2c-c10d-4cb4-9944-15e23e028d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:09Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3513d7c4-f3ab-4782-9301-ead4a1bebd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3513d7c4-f3ab-4782-9301-ead4a1bebd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a7420c-ffd5-47f5-8dc7-dbdab7dab7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a7420c-ffd5-47f5-8dc7-dbdab7dab7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f428a2c-c10d-4cb4-9944-15e23e028d61', 'volume_name': 'volume-9f428a2c-c10d-4cb4-9944-15e23e028d61', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43039ec8-a89c-468a-99e6-d86779e2a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43039ec8-a89c-468a-99e6-d86779e2a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bef875-d0a4-4070-a02b-ffd9fd7921be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:08 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Volume 9f428a2c-c10d-4cb4-9944-15e23e028d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f428a2c-c10d-4cb4-9944-15e23e028d61', 'volume_size': 1}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:08 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece 1073741824" returned: 0 in 0.741s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:09 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece
Apr 20 18:44:09 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (341edcc0-28e5-4923-bd5d-320abc235fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16caf7-f74d-4450-a211-87ceee97779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b16caf7-f74d-4450-a211-87ceee97779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-80114373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05cc5a0-e970-406c-ba57-72eb2b1613ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:09Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e32aa2-1073-4b79-a056-44b0f364b19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e32aa2-1073-4b79-a056-44b0f364b19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305b4ea-216e-4842-8b31-1b64741508f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305b4ea-216e-4842-8b31-1b64741508f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05cc5a0-e970-406c-ba57-72eb2b1613ee', 'volume_name': 'volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ca5127-06dc-44b6-9c6f-72ef5632f2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ca5127-06dc-44b6-9c6f-72ef5632f2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5a4ad7-538d-40e2-9696-40014ad755a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:09 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Volume b05cc5a0-e970-406c-ba57-72eb2b1613ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee', 'volume_size': 1}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:09 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.674s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:09 devstack sudo[88993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f
Apr 20 18:44:09 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:09 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1334975647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba62ab2-2476-407d-8dd0-324f63ec3308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:08Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Creating volume cba62ab2-2476-407d-8dd0-324f63ec3308 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:09 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad633a5-7c7b-4263-a1fc-8a7d1d7c75f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590cae8a-d4ae-4158-a88c-29ac165b4e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:09 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308 1073741824
Apr 20 18:44:09 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:09 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Volume volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece (1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece): created successfully
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590cae8a-d4ae-4158-a88c-29ac165b4e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (d4134781-e4b6-4013-87ea-075f576b1c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:09 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f5ef039a-6bc9-4bbb-8e1b-65401f1121ad tempest-CreateVolumesFromImageTest-1272267530 None] Created volume successfully.
Apr 20 18:44:09 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f" returned: 0 in 0.598s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:09 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f
Apr 20 18:44:09 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:10 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308 1073741824" returned: 0 in 0.674s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:10 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308
Apr 20 18:44:10 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:10 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323.5b49c7aa-f549-459f-9f7d-35962b83682f" returned: 0 in 0.521s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-5b49c7aa-f549-459f-9f7d-35962b83682f" released by "_delete_snapshot" :: held 2.467s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-f3080240-7e2d-4260-a14c-1aebeb892323" released by "delete_snapshot" :: held 2.481s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Created reservations ['1fb88dd7-b37b-4a26-869e-98cc2239780b', 'e59c080a-fa5c-415e-9746-861247c329ae', 'c2dfed0b-8575-4155-8ded-a18deeae4386', 'aba5f284-2bc8-40b1-bd7f-652607af65c6'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Delete snapshot completed successfully.
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7654cc82-988d-49fd-b3c4-6a16257ba697 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-5b49c7aa-f549-459f-9f7d-35962b83682f-delete_snapshot" released by "delete_snapshot" :: held 2.567s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (6b284e2b-e845-491d-bbf1-60e8fd8b6482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4122ef7-7b94-45fa-b081-3492deaa5799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:10 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4122ef7-7b94-45fa-b081-3492deaa5799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859026963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:11Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c339d0c7-66dc-4ba7-a65d-d880d042be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c339d0c7-66dc-4ba7-a65d-d880d042be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ec84d5-64d2-4d8a-bb4a-d4be299cf6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ec84d5-64d2-4d8a-bb4a-d4be299cf6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f', 'volume_name': 'volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22e5c69-f510-4ade-b4e9-4a4f73629140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22e5c69-f510-4ade-b4e9-4a4f73629140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e62a53a-84fa-4f42-ad81-c59570ffeb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:10 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume 98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f', 'volume_size': 1}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308" returned: 0 in 0.559s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-162209889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92811d9f-82ca-4480-b670-407079e5567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:08Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Creating volume 92811d9f-82ca-4480-b670-407079e5567a {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:10 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5bc4d53-af97-4d0b-86bf-1631c92669a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba62ab2-2476-407d-8dd0-324f63ec3308', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae419e3-6825-40cc-83d7-8eee20c8d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:10 devstack sudo[89011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a 1073741824
Apr 20 18:44:10 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:10 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Volume volume-cba62ab2-2476-407d-8dd0-324f63ec3308 (cba62ab2-2476-407d-8dd0-324f63ec3308): created successfully
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae419e3-6825-40cc-83d7-8eee20c8d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (1e6f9ad0-a14d-4763-ba7b-2b7b0c8822dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-253c968b-1805-4cab-a33e-ba43cdb5495b tempest-CreateVolumesFromImageTest-1272267530 None] Created volume successfully.
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-f3080240-7e2d-4260-a14c-1aebeb892323-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-f3080240-7e2d-4260-a14c-1aebeb892323-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-quobyte-f3080240-7e2d-4260-a14c-1aebeb892323" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-f3080240-7e2d-4260-a14c-1aebeb892323" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677da57-7951-4311-8b7e-51e1d92c0961]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:11 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a 1073741824" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:11 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:44:11 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:11 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a
Apr 20 18:44:11 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:11 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.532s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:11 devstack sudo[89025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323
Apr 20 18:44:11 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:11 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.076s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1989658950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f428a2c-c10d-4cb4-9944-15e23e028d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:09Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Creating volume 9f428a2c-c10d-4cb4-9944-15e23e028d61 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:11 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae9e929-3765-4f27-8360-113e213385ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92811d9f-82ca-4480-b670-407079e5567a', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:11 devstack sudo[89027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 1073741824
Apr 20 18:44:11 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9954f96-3234-49e3-bf53-10697bb87d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:11 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Volume volume-92811d9f-82ca-4480-b670-407079e5567a (92811d9f-82ca-4480-b670-407079e5567a): created successfully
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9954f96-3234-49e3-bf53-10697bb87d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (11b8cdab-6cc0-495d-b885-751e44f6e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e4aa3eb7-8d60-4519-9f36-b932c5f2fb43 tempest-CreateVolumesFromImageTest-1272267530 None] Created volume successfully.
Apr 20 18:44:12 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f3080240-7e2d-4260-a14c-1aebeb892323" returned: 0 in 0.451s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-f3080240-7e2d-4260-a14c-1aebeb892323" released by "delete_volume" :: held 1.033s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Created reservations ['49195b7c-468a-4e05-be6c-34f161f48b46', 'dce0c936-fbcb-4cfe-952d-32011d7b2220', '3c64cf01-3670-40c0-be17-ee653eb1ff38', '4d6a3b55-62d5-4458-a466-483a80908dc0'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:12 devstack sudo[89030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:12 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:12 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 1073741824" returned: 0 in 0.655s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:12 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61
Apr 20 18:44:12 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:12 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.511s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:12 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Deleted volume successfully.
Apr 20 18:44:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f3f5a2dd-cbd4-4fd6-b35d-f72955413d8b tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-f3080240-7e2d-4260-a14c-1aebeb892323-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:13 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-80114373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05cc5a0-e970-406c-ba57-72eb2b1613ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4961ada0134211b141ca859df26a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:09Z,use_quota=True,user_id='b1eaab0413b44a569733de1efbbc4329',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Creating volume b05cc5a0-e970-406c-ba57-72eb2b1613ee {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:13 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bef875-d0a4-4070-a02b-ffd9fd7921be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f428a2c-c10d-4cb4-9944-15e23e028d61', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd64f3b9-d430-4bb5-b33f-719dd34a14c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:13 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee 1073741824
Apr 20 18:44:13 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:13 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Volume volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 (9f428a2c-c10d-4cb4-9944-15e23e028d61): created successfully
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd64f3b9-d430-4bb5-b33f-719dd34a14c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (66125973-0607-4782-a240-f9aa84516592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-81f15358-2f40-4f42-8481-de16f793d3f2 tempest-CreateVolumesFromImageTest-1272267530 None] Created volume successfully.
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-913bdacb-05fd-43df-886f-efca95cbc76a-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-913bdacb-05fd-43df-886f-efca95cbc76a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "cinder-quobyte-913bdacb-05fd-43df-886f-efca95cbc76a" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-913bdacb-05fd-43df-886f-efca95cbc76a" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b7fe80-f2a0-4367-b5c7-c91ee166bd39]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:13 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a
Apr 20 18:44:13 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:13 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee 1073741824" returned: 0 in 0.589s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:13 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee
Apr 20 18:44:13 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:14 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:14 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a
Apr 20 18:44:14 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:14 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee" returned: 0 in 0.480s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.436s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859026963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:11Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Creating volume 98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:14 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5a4ad7-538d-40e2-9696-40014ad755a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:14 devstack sudo[89055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f 1073741824
Apr 20 18:44:14 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2b3436-b9da-48fc-a20d-990b57c278eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:14 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Volume volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee (b05cc5a0-e970-406c-ba57-72eb2b1613ee): created successfully
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2b3436-b9da-48fc-a20d-990b57c278eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Flow 'volume_create_manager' (341edcc0-28e5-4923-bd5d-320abc235fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7f9beb25-dedc-4c34-9926-db17dfaa02a1 tempest-CreateVolumesFromImageTest-1272267530 None] Created volume successfully.
Apr 20 18:44:14 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-913bdacb-05fd-43df-886f-efca95cbc76a" returned: 0 in 0.472s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-quobyte-913bdacb-05fd-43df-886f-efca95cbc76a" released by "delete_volume" :: held 1.040s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Created reservations ['a44ea7ce-23be-46ad-b061-48d3dec0c9e2', 'da600303-d4dc-4d9c-82a8-3a09a7349eb2', 'c66613c4-1ff1-4c9a-b8c0-1bdb784ec281', '993b70d5-c9f4-4357-973e-98ca7ebe8914'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-b05cc5a0-e970-406c-ba57-72eb2b1613ee-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:14 devstack sudo[89058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:14 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3125469d-44b9-4a4e-a18b-d401d29b46f4 tempest-GroupsV320Test-652338598 None] Group tempest-GroupsV320Test-Group-499724271: creating
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-b05cc5a0-e970-406c-ba57-72eb2b1613ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-quobyte-b05cc5a0-e970-406c-ba57-72eb2b1613ee" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3125469d-44b9-4a4e-a18b-d401d29b46f4 tempest-GroupsV320Test-652338598 None] Group tempest-GroupsV320Test-Group-499724271: created successfully
Apr 20 18:44:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3125469d-44b9-4a4e-a18b-d401d29b46f4 tempest-GroupsV320Test-652338598 None] Create group completed successfully.
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-b05cc5a0-e970-406c-ba57-72eb2b1613ee" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3637b6bc-8ea2-4fb8-becd-c33613f32c9d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:14 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f 1073741824" returned: 0 in 0.590s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:14 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee
Apr 20 18:44:14 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:14 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f
Apr 20 18:44:14 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:15 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.509s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:15 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Deleted volume successfully.
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a770359a-39be-49b2-863e-8b77f04ec549 tempest-SnapshotDependencyTests-1977696549 None] Lock "cinder-913bdacb-05fd-43df-886f-efca95cbc76a-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:15 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f" returned: 0 in 0.424s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e62a53a-84fa-4f42-ad81-c59570ffeb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1772a4c8-d474-499a-9546-4a41de58cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:15 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f (98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f): created successfully
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1772a4c8-d474-499a-9546-4a41de58cb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (6b284e2b-e845-491d-bbf1-60e8fd8b6482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:15 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee" returned: 0 in 0.577s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:15 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-11a50c22-0ed3-4b8b-ac47-88d85e5c7e1f tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created volume successfully.
Apr 20 18:44:15 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee
Apr 20 18:44:15 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:15 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b05cc5a0-e970-406c-ba57-72eb2b1613ee" returned: 0 in 0.440s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-b05cc5a0-e970-406c-ba57-72eb2b1613ee" released by "delete_volume" :: held 1.042s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Created reservations ['293c1924-4c78-4b2e-a55b-61e01d2607f8', '52661ccd-1ab0-4926-b3e9-027fe7c989fc', '7787fc62-6312-4aa5-9d97-c26c63531a71', 'aec69c79-9747-449c-b2e9-0379f0db8c70'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:15 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:15 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Created reservations ['14b34009-fdc0-4ad2-bb30-ed656651ca23'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:16 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:16 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:16 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (c1b8a20b-f880-4f52-b21d-06c71af14f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0838a885-be0b-4a36-b493-88ccd83831da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.509s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Deleted volume successfully.
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0838a885-be0b-4a36-b493-88ccd83831da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264369626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f827d6-c1ca-4ec3-b90e-c8870248270b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:16Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955eb7b0-e130-4a6a-bada-69953e6871eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955eb7b0-e130-4a6a-bada-69953e6871eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdb59ba-6522-4209-bf20-ef710096bdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdb59ba-6522-4209-bf20-ef710096bdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f827d6-c1ca-4ec3-b90e-c8870248270b', 'volume_name': 'volume-31f827d6-c1ca-4ec3-b90e-c8870248270b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41f20a7-1c9e-436f-b25e-fa5ede5425b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41f20a7-1c9e-436f-b25e-fa5ede5425b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203b82e6-f5e0-4bcb-93df-8964fe354a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume 31f827d6-c1ca-4ec3-b90e-c8870248270b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f827d6-c1ca-4ec3-b90e-c8870248270b', 'volume_size': 1}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1264369626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f827d6-c1ca-4ec3-b90e-c8870248270b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:16Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Creating volume 31f827d6-c1ca-4ec3-b90e-c8870248270b {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:16 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-b3c3d18b-f35b-4705-8d11-bf8db8c02763 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-b05cc5a0-e970-406c-ba57-72eb2b1613ee-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:16 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b 1073741824
Apr 20 18:44:16 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (a62435d1-ecd9-4906-9752-b8b8b5306726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f11f50-23b0-47ce-99ef-a31b4693f99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f11f50-23b0-47ce-99ef-a31b4693f99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874658463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afaf793-8584-49f1-a35a-365d8d2fb47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d11b31-d65e-4ea7-9389-db19482ca26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d11b31-d65e-4ea7-9389-db19482ca26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c37bf4-d35b-4e5b-a5f5-556d909ae866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c37bf4-d35b-4e5b-a5f5-556d909ae866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afaf793-8584-49f1-a35a-365d8d2fb47e', 'volume_name': 'volume-1afaf793-8584-49f1-a35a-365d8d2fb47e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3c73b1-a683-4d32-bcff-788c666ab511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3c73b1-a683-4d32-bcff-788c666ab511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038c0680-e4d8-46fb-9d33-11cde20a17c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume 1afaf793-8584-49f1-a35a-365d8d2fb47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afaf793-8584-49f1-a35a-365d8d2fb47e', 'volume_size': 1}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (f4d5bd1e-3715-4895-9b3c-88867db139c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d8c684-d821-4736-9d14-d6131d4b1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d8c684-d821-4736-9d14-d6131d4b1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26053654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937e109c-0cd4-4789-b5ea-6b49de7d47be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2960ac44-59b3-4b32-a8ae-d6196959a4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2960ac44-59b3-4b32-a8ae-d6196959a4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b50a14-8bf3-4eda-aaff-24fe298fd25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b50a14-8bf3-4eda-aaff-24fe298fd25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937e109c-0cd4-4789-b5ea-6b49de7d47be', 'volume_name': 'volume-937e109c-0cd4-4789-b5ea-6b49de7d47be', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cf4b13-6105-4c57-8c74-f21aeec4094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cf4b13-6105-4c57-8c74-f21aeec4094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226d68cf-11a8-4722-a6f0-a0980e1a3d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:16 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume 937e109c-0cd4-4789-b5ea-6b49de7d47be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937e109c-0cd4-4789-b5ea-6b49de7d47be', 'volume_size': 1}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-9f428a2c-c10d-4cb4-9944-15e23e028d61-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.713s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-dce7cecc-694a-461d-b719-74c27fc6502c tempest-GroupsV320Test-652338598 None] Delete group completed successfully.
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-9f428a2c-c10d-4cb4-9944-15e23e028d61-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-quobyte-9f428a2c-c10d-4cb4-9944-15e23e028d61" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-9f428a2c-c10d-4cb4-9944-15e23e028d61" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d1e89-4684-4e3a-af9f-e57159f8f97e]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:17 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61
Apr 20 18:44:17 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (357d0a99-a2c5-4c93-808a-fbe33bd83aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba2050-3edd-4ffb-84d5-97763a18c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba2050-3edd-4ffb-84d5-97763a18c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960662954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb21c40-5304-47a3-b12d-2e45241a579d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6764bec7-ceb0-4a58-b0f3-9f5c6cea7a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6764bec7-ceb0-4a58-b0f3-9f5c6cea7a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0db6be-5e45-4542-88e4-5a983b291758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0db6be-5e45-4542-88e4-5a983b291758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb21c40-5304-47a3-b12d-2e45241a579d', 'volume_name': 'volume-ebb21c40-5304-47a3-b12d-2e45241a579d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a0e744-b6ea-488c-b48b-48075f65c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a0e744-b6ea-488c-b48b-48075f65c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef476f26-47a9-44bf-81a4-04c45c9efb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume ebb21c40-5304-47a3-b12d-2e45241a579d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb21c40-5304-47a3-b12d-2e45241a579d', 'volume_size': 1}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:17 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b 1073741824" returned: 0 in 0.951s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (e65ea077-ebb9-4188-a6e9-ea14a315dd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca83199f-37cb-484e-a795-e86f5e764d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca83199f-37cb-484e-a795-e86f5e764d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648165274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5873d624-464c-431d-947e-dd3613b4804b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee32843-ab78-4662-8626-17954bfe0ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee32843-ab78-4662-8626-17954bfe0ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c673f013-34f9-49a1-924d-9b71e0427167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c673f013-34f9-49a1-924d-9b71e0427167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5873d624-464c-431d-947e-dd3613b4804b', 'volume_name': 'volume-5873d624-464c-431d-947e-dd3613b4804b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5965f0e2-db02-4eed-893f-176cfac81707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5965f0e2-db02-4eed-893f-176cfac81707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0032b7-1f6b-4169-ae39-1b2f484fdc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:17 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume 5873d624-464c-431d-947e-dd3613b4804b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5873d624-464c-431d-947e-dd3613b4804b', 'volume_size': 1}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:17 devstack sudo[89094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b
Apr 20 18:44:17 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:17 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61" returned: 0 in 0.702s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:17 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61
Apr 20 18:44:17 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:18 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b" returned: 0 in 0.575s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874658463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afaf793-8584-49f1-a35a-365d8d2fb47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Creating volume 1afaf793-8584-49f1-a35a-365d8d2fb47e {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:18 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203b82e6-f5e0-4bcb-93df-8964fe354a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f827d6-c1ca-4ec3-b90e-c8870248270b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac08f6c-dead-4624-9b9f-d6d1e0b6af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:18 devstack sudo[89135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e 1073741824
Apr 20 18:44:18 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:18 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume volume-31f827d6-c1ca-4ec3-b90e-c8870248270b (31f827d6-c1ca-4ec3-b90e-c8870248270b): created successfully
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac08f6c-dead-4624-9b9f-d6d1e0b6af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (c1b8a20b-f880-4f52-b21d-06c71af14f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:18 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a2acb5a1-defc-4929-ac13-fada71d05abe tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created volume successfully.
Apr 20 18:44:18 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-9f428a2c-c10d-4cb4-9944-15e23e028d61" returned: 0 in 0.632s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-9f428a2c-c10d-4cb4-9944-15e23e028d61" released by "delete_volume" :: held 1.354s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Created reservations ['0f8b98bb-c98f-4e6a-8cc8-0df73e55c572', '8b25a2c8-99c2-4989-adfd-47e17bc55a29', 'd52bb8a6-239d-4bd2-b722-05e0927de8b8', '193c8fb6-8d4c-4319-9d63-f6b8cbab720e'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:18 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:18 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:18 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e 1073741824" returned: 0 in 0.710s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:18 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:18 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Deleted volume successfully.
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-98c5b98a-865b-435b-aacf-7574f91d298d tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-9f428a2c-c10d-4cb4-9944-15e23e028d61-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:18 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e
Apr 20 18:44:18 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-92811d9f-82ca-4480-b670-407079e5567a-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-92811d9f-82ca-4480-b670-407079e5567a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-quobyte-92811d9f-82ca-4480-b670-407079e5567a" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-92811d9f-82ca-4480-b670-407079e5567a" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fb53ce-a577-4587-b1cf-953b43df4a21]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:19 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a
Apr 20 18:44:19 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:19 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.602s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26053654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937e109c-0cd4-4789-b5ea-6b49de7d47be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Creating volume 937e109c-0cd4-4789-b5ea-6b49de7d47be {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:19 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038c0680-e4d8-46fb-9d33-11cde20a17c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afaf793-8584-49f1-a35a-365d8d2fb47e', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0989e3e-0d8e-4fd2-8655-e8da005b3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:19 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume volume-1afaf793-8584-49f1-a35a-365d8d2fb47e (1afaf793-8584-49f1-a35a-365d8d2fb47e): created successfully
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0989e3e-0d8e-4fd2-8655-e8da005b3479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (a62435d1-ecd9-4906-9752-b8b8b5306726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:19 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-08dec3f0-2c8e-411b-89ce-9e7bc77fd3f2 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created volume successfully.
Apr 20 18:44:19 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be 1073741824
Apr 20 18:44:19 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:19 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a" returned: 0 in 0.594s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:19 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a
Apr 20 18:44:19 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:20 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be 1073741824" returned: 0 in 0.718s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:20 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be
Apr 20 18:44:20 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:20 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92811d9f-82ca-4480-b670-407079e5567a" returned: 0 in 0.587s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-92811d9f-82ca-4480-b670-407079e5567a" released by "delete_volume" :: held 1.211s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Created reservations ['85b9e96b-e204-4852-b8e9-f1376725c5ca', 'cda3167c-da83-4156-8489-b8ed15fd7104', '03d142ba-ceb1-4cd6-8f24-c75b1e8a0081', '501afdc8-0419-4ae6-adb4-5c0c3c58468f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:20 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:20 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:20 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be" returned: 0 in 0.529s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.591s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960662954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb21c40-5304-47a3-b12d-2e45241a579d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Creating volume ebb21c40-5304-47a3-b12d-2e45241a579d {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:20 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226d68cf-11a8-4722-a6f0-a0980e1a3d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937e109c-0cd4-4789-b5ea-6b49de7d47be', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767488ee-eed4-43af-b94c-dd4fc3ea388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:20 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d 1073741824
Apr 20 18:44:20 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:20 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume volume-937e109c-0cd4-4789-b5ea-6b49de7d47be (937e109c-0cd4-4789-b5ea-6b49de7d47be): created successfully
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767488ee-eed4-43af-b94c-dd4fc3ea388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (f4d5bd1e-3715-4895-9b3c-88867db139c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:20 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d75cbf65-3a96-4882-8f8a-e1fe8a602f33 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created volume successfully.
Apr 20 18:44:21 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.612s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Deleted volume successfully.
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-c55bf5d5-9ff8-4ee9-87f1-f678d53e3340 tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-92811d9f-82ca-4480-b670-407079e5567a-delete_volume" released by "delete_volume" :: held 1.962s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-cba62ab2-2476-407d-8dd0-324f63ec3308-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-cba62ab2-2476-407d-8dd0-324f63ec3308-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-quobyte-cba62ab2-2476-407d-8dd0-324f63ec3308" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-cba62ab2-2476-407d-8dd0-324f63ec3308" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:21 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d 1073741824" returned: 0 in 0.625s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f344a7e-1632-4e82-a6fb-cd91034cb6fa]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:21 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d
Apr 20 18:44:21 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:21 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308
Apr 20 18:44:21 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:21 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d" returned: 0 in 0.481s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.346s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648165274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5873d624-464c-431d-947e-dd3613b4804b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ca5081b9f24711a62cc5f441300c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:17Z,use_quota=True,user_id='2a2944d8a9b84fcc9853f971c5714662',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Creating volume 5873d624-464c-431d-947e-dd3613b4804b {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:21 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:21 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308" returned: 0 in 0.528s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:21 devstack sudo[89181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b 1073741824
Apr 20 18:44:21 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef476f26-47a9-44bf-81a4-04c45c9efb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb21c40-5304-47a3-b12d-2e45241a579d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d67950b-a476-4ff4-b3b4-7246ed67b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:21 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308
Apr 20 18:44:21 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:21 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume volume-ebb21c40-5304-47a3-b12d-2e45241a579d (ebb21c40-5304-47a3-b12d-2e45241a579d): created successfully
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d67950b-a476-4ff4-b3b4-7246ed67b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (357d0a99-a2c5-4c93-808a-fbe33bd83aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7b86ad47-a41d-4ea2-a4c7-9d28c2aef70a tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created volume successfully.
Apr 20 18:44:22 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-cba62ab2-2476-407d-8dd0-324f63ec3308" returned: 0 in 0.415s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-cba62ab2-2476-407d-8dd0-324f63ec3308" released by "delete_volume" :: held 0.982s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Created reservations ['ace0af9d-74d7-49bc-bf30-2036b6eb986d', '37e1352e-ec89-4f83-a58f-8b26f9ffd5a4', '0d44da4b-3c1c-4b84-9509-0df78f702bf3', 'b3224aa9-1208-4e1f-ae2b-3509189b5de3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:22 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b 1073741824" returned: 0 in 0.560s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:22 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:22 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:22 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b
Apr 20 18:44:22 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:22 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.439s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:22 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Deleted volume successfully.
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-34a14b58-017d-4b31-af6f-037f29e85edc tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-cba62ab2-2476-407d-8dd0-324f63ec3308-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:22 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b" returned: 0 in 0.434s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0032b7-1f6b-4169-ae39-1b2f484fdc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5873d624-464c-431d-947e-dd3613b4804b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089f32e3-db38-4dd0-813e-d21759b2469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Volume volume-5873d624-464c-431d-947e-dd3613b4804b (5873d624-464c-431d-947e-dd3613b4804b): created successfully
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089f32e3-db38-4dd0-813e-d21759b2469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Flow 'volume_create_manager' (e65ea077-ebb9-4188-a6e9-ea14a315dd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:22 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e17f023e-47aa-43d2-89d0-8949ecd37f69 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created volume successfully.
Apr 20 18:44:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "cinder-quobyte-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:23 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:23 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a175f5-9654-45e0-8986-aff90b213752]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:23 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece
Apr 20 18:44:23 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-5873d624-464c-431d-947e-dd3613b4804b-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-5873d624-464c-431d-947e-dd3613b4804b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-quobyte-5873d624-464c-431d-947e-dd3613b4804b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-5873d624-464c-431d-947e-dd3613b4804b" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7730dbc-6360-4f41-b8be-29bcfa8f99ff]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:24 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece" returned: 0 in 0.567s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:24 devstack sudo[89201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece
Apr 20 18:44:24 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:24 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b
Apr 20 18:44:24 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:24 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-quobyte-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece" released by "delete_volume" :: held 1.037s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:24 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b" returned: 0 in 0.543s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Created reservations ['fded950f-8881-4c77-833a-23889b97720c', '4c314063-8104-44c7-92a9-ca4da86ac2bf', 'b9569dac-e8e2-4d72-a38c-d4e8c18a8cd3', 'e16fa164-584f-4e33-8d40-66b634c6ec7d'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:24 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b
Apr 20 18:44:24 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:24 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:24 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:25 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5873d624-464c-431d-947e-dd3613b4804b" returned: 0 in 0.440s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-5873d624-464c-431d-947e-dd3613b4804b" released by "delete_volume" :: held 1.008s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created reservations ['bf06eb2d-85c7-479e-ab01-5d0cc9511e0f', '05bac9b6-3b64-4c79-8ac2-af1e842f8273', '4d5629ca-d36b-410a-a3fa-acc58ce2df9e', '8b88cedf-3508-4aab-9c25-a6832db9d127'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:25 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:25 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:25 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Deleted volume successfully.
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d6d6d9f8-b275-4944-9cfb-52c14bab1e4f tempest-CreateVolumesFromImageTest-1272267530 None] Lock "cinder-1b3e2dbc-e0cc-490a-a3ad-6a5af47e1ece-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:25 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.441s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Deleted volume successfully.
Apr 20 18:44:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ca5e3284-5d45-4921-9294-6c7eda22f0c9 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-5873d624-464c-431d-947e-dd3613b4804b-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-ebb21c40-5304-47a3-b12d-2e45241a579d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-ebb21c40-5304-47a3-b12d-2e45241a579d-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-quobyte-ebb21c40-5304-47a3-b12d-2e45241a579d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-ebb21c40-5304-47a3-b12d-2e45241a579d" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dcd50d-6746-451d-b938-498df20d48a2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:26 devstack sudo[89217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d
Apr 20 18:44:26 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:26 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:26 devstack sudo[89222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d
Apr 20 18:44:26 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:27 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-ebb21c40-5304-47a3-b12d-2e45241a579d" returned: 0 in 0.426s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-ebb21c40-5304-47a3-b12d-2e45241a579d" released by "delete_volume" :: held 0.986s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created reservations ['2d417584-ecf9-4ee2-b38c-30615cc9ef6a', 'a3b4c57f-afff-4c24-b44d-001ac35d695c', '258761f0-5f11-4333-9ca5-01dbfef486b8', '60047332-98ab-4b30-981a-64c4e57af60b'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:27 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:27 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-937e109c-0cd4-4789-b5ea-6b49de7d47be-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-937e109c-0cd4-4789-b5ea-6b49de7d47be-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-quobyte-937e109c-0cd4-4789-b5ea-6b49de7d47be" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-937e109c-0cd4-4789-b5ea-6b49de7d47be" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57b106d-e19b-4e3a-91e3-2ad3d03c5673]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:27 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be
Apr 20 18:44:27 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (3aa70489-65c5-4f98-8ca6-7b5ce0dbd913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22311ac-5fed-492d-a2c7-deed26ae9e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22311ac-5fed-492d-a2c7-deed26ae9e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1478184809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034714d8-92a0-4cc5-b108-f0b78ca4a2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc2cebf850f485d9907c784fbac7a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:28Z,use_quota=True,user_id='e1ce4b0d1e90432c93ee76c1e8f9d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8604ae14-ddd0-4178-b62e-76fe169ade66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8604ae14-ddd0-4178-b62e-76fe169ade66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a73b6ae-5e71-4975-9767-a0c6ff2d8fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a73b6ae-5e71-4975-9767-a0c6ff2d8fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034714d8-92a0-4cc5-b108-f0b78ca4a2d6', 'volume_name': 'volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1b5397-69d5-47cc-950d-64f0c7edcf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be1b5397-69d5-47cc-950d-64f0c7edcf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690152a2-b1e2-4797-915e-1d253c546dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:27 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Volume 034714d8-92a0-4cc5-b108-f0b78ca4a2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6', 'volume_size': 1}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1478184809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034714d8-92a0-4cc5-b108-f0b78ca4a2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc2cebf850f485d9907c784fbac7a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:28Z,use_quota=True,user_id='e1ce4b0d1e90432c93ee76c1e8f9d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Creating volume 034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:27 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:27 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 1073741824
Apr 20 18:44:27 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:27 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.468s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Deleted volume successfully.
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4d85bbfc-baef-44c3-9908-2e8697875ca5 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-ebb21c40-5304-47a3-b12d-2e45241a579d-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:27 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be" returned: 0 in 0.563s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:28 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be
Apr 20 18:44:28 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:28 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 1073741824" returned: 0 in 0.543s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:28 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:28 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:28 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-937e109c-0cd4-4789-b5ea-6b49de7d47be" returned: 0 in 0.455s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-937e109c-0cd4-4789-b5ea-6b49de7d47be" released by "delete_volume" :: held 1.043s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created reservations ['636a9df9-9493-49f9-90b2-482e2cd8853b', '84e0c0de-3101-410e-99da-0de8ea48b21d', '61c4fb8e-9458-47d2-8039-2339dcf5f15e', 'f66b0ef1-203d-4fea-af1b-8a0c893a8d25'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-1afaf793-8584-49f1-a35a-365d8d2fb47e-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:28 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:28 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-1afaf793-8584-49f1-a35a-365d8d2fb47e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-quobyte-1afaf793-8584-49f1-a35a-365d8d2fb47e" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-1afaf793-8584-49f1-a35a-365d8d2fb47e" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[effe62a5-8837-4f66-917b-aa6512ca8c91]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:28 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e
Apr 20 18:44:28 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:28 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690152a2-b1e2-4797-915e-1d253c546dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dc9940-0a59-40e9-8ba0-748ccf721bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:28 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Volume volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 (034714d8-92a0-4cc5-b108-f0b78ca4a2d6): created successfully
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83dc9940-0a59-40e9-8ba0-748ccf721bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (3aa70489-65c5-4f98-8ca6-7b5ce0dbd913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-14047bd2-ea68-433d-9c06-f3c3a1220feb tempest-VolumeDependencyTests-2141591752 None] Created volume successfully.
Apr 20 18:44:29 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.522s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Deleted volume successfully.
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0a48657-a298-475d-8deb-36dadeb27678 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-937e109c-0cd4-4789-b5ea-6b49de7d47be-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:29 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e" returned: 0 in 0.568s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:29 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e
Apr 20 18:44:29 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:29 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1afaf793-8584-49f1-a35a-365d8d2fb47e" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-1afaf793-8584-49f1-a35a-365d8d2fb47e" released by "delete_volume" :: held 1.061s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created reservations ['a18f4d16-5ce4-43ff-b1e2-3e999248cd45', 'ab2fed3b-13b0-452b-8b67-1029e5cf6a47', 'ca198522-b56d-4093-b39d-cd46a4918681', '12dac7eb-9c51-4e81-a3de-3478eeb4a81d'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:29 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:29 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Creating offline snapshot a9b45131-25f9-4fbd-85ec-7d7e398b55a2 of volume 034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a8f10-e991-44af-b504-c3459c505de4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:30 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:30 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:30 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:30 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Deleted volume successfully.
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7fa5ca9b-3c6b-4543-b805-d7c9d1fbbbb1 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-1afaf793-8584-49f1-a35a-365d8d2fb47e-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:30 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.533s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:30 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 1G
Apr 20 18:44:30 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-31f827d6-c1ca-4ec3-b90e-c8870248270b-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-31f827d6-c1ca-4ec3-b90e-c8870248270b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-quobyte-31f827d6-c1ca-4ec3-b90e-c8870248270b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-31f827d6-c1ca-4ec3-b90e-c8870248270b" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312ec98-a6d0-4082-a8d2-68ec63345d0c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:30 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b
Apr 20 18:44:30 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Flow 'volume_create_manager' (5b3dfd54-6629-425e-81b9-5f7715513511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:30 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb9fb55-a511-4004-8bb3-bef95920ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb9fb55-a511-4004-8bb3-bef95920ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1604763891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20807988-6942-4cf7-a47f-ba94db7a9b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44f620ff27e4759a52d022aae636a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:31Z,use_quota=True,user_id='0b78f9078ada4bee8cf8f4acf19fa186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70bda5b-08cf-47b0-a64a-eff1c0d060b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70bda5b-08cf-47b0-a64a-eff1c0d060b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce93d23-221f-47bf-9bf9-2642bc66c0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ce93d23-221f-47bf-9bf9-2642bc66c0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20807988-6942-4cf7-a47f-ba94db7a9b8c', 'volume_name': 'volume-20807988-6942-4cf7-a47f-ba94db7a9b8c', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d55f24-b7d9-4b1a-a629-8a989edfd9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d55f24-b7d9-4b1a-a629-8a989edfd9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3433ddea-7fcd-46b4-ab67-3e199fa79392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Volume 20807988-6942-4cf7-a47f-ba94db7a9b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20807988-6942-4cf7-a47f-ba94db7a9b8c', 'volume_size': 1}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:31 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 1G" returned: 0 in 0.579s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:31 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2
Apr 20 18:44:31 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:31 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b" returned: 0 in 0.517s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:31 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b
Apr 20 18:44:31 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:31 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2" returned: 0 in 0.425s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:31 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 is being set with open permissions: ugo+rw
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:31 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2
Apr 20 18:44:31 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:31 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f827d6-c1ca-4ec3-b90e-c8870248270b" returned: 0 in 0.402s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-31f827d6-c1ca-4ec3-b90e-c8870248270b" released by "delete_volume" :: held 0.951s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created reservations ['6695f924-359f-4228-864e-4f2688e06010', 'ee021c1b-7688-475c-a7f0-1e19e6fca303', '2079f55d-12b0-484e-8702-c6af9d6d8694', 'fbef3d70-470b-4c0d-a633-0d461019016f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:31 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:31 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:31 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2" returned: 0 in 0.434s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "cinder-quobyte-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:31 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info
Apr 20 18:44:31 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae6fa12-1a53-4ade-b7eb-9e665478b2e2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:32 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f
Apr 20 18:44:32 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:32 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Deleted volume successfully.
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba168822-e625-49e0-a774-70203251dcd4 tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-31f827d6-c1ca-4ec3-b90e-c8870248270b-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:32 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info" returned: 0 in 0.419s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:32 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info is being set with open permissions: ugo+rw
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:32 devstack sudo[89295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info
Apr 20 18:44:32 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:32 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:32 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f
Apr 20 18:44:32 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:32 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.info" returned: 0 in 0.398s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.867s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1604763891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20807988-6942-4cf7-a47f-ba94db7a9b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44f620ff27e4759a52d022aae636a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:31Z,use_quota=True,user_id='0b78f9078ada4bee8cf8f4acf19fa186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Creating volume 20807988-6942-4cf7-a47f-ba94db7a9b8c {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:32 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:32 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c 1073741824
Apr 20 18:44:32 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-079f9ff6-5fe0-45fc-987b-a98e8b645989 tempest-VolumeDependencyTests-2141591752 None] Create snapshot completed successfully
Apr 20 18:44:32 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f" returned: 0 in 0.417s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-quobyte-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f" released by "delete_volume" :: held 0.924s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Created reservations ['cc4c3ddc-267a-4fdc-877e-286e1d2bdafc', 'd07429a8-44a4-488e-b822-0a6550f3ea3c', '130d6a32-b175-469c-914c-4c14b9742fc7', 'b4677e34-a0c9-4ae7-b652-274e18c3c351'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:32 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:32 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:33 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (52f62edd-54ee-4c92-886d-01a624888949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725b985d-fca8-48ea-9650-8b54ee198024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c 1073741824" returned: 0 in 0.588s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725b985d-fca8-48ea-9650-8b54ee198024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464193050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705b1274-65b7-46c5-93ab-e3120bd265df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc2cebf850f485d9907c784fbac7a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9b45131-25f9-4fbd-85ec-7d7e398b55a2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:33Z,use_quota=True,user_id='e1ce4b0d1e90432c93ee76c1e8f9d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29747839-1a58-4c30-a91c-0ba6cbb1d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29747839-1a58-4c30-a91c-0ba6cbb1d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dfc1bd-7f0d-4e5d-8a6b-db93f78314c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51dfc1bd-7f0d-4e5d-8a6b-db93f78314c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '705b1274-65b7-46c5-93ab-e3120bd265df', 'volume_name': 'volume-705b1274-65b7-46c5-93ab-e3120bd265df', 'volume_size': 1, 'snapshot_id': 'a9b45131-25f9-4fbd-85ec-7d7e398b55a2'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab0a62-9053-4b45-8b7f-72278aab1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ab0a62-9053-4b45-8b7f-72278aab1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a7295b-820e-468b-9b61-bfc302427597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:33 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Volume 705b1274-65b7-46c5-93ab-e3120bd265df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-705b1274-65b7-46c5-93ab-e3120bd265df', 'volume_size': 1, 'snapshot_id': 'a9b45131-25f9-4fbd-85ec-7d7e398b55a2'}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:33 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c
Apr 20 18:44:33 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:33 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.586s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Deleted volume successfully.
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f43c0353-2e88-4403-8746-ed80933bb4aa tempest-CreateVolumesFromSourceVolumeTest-716709870 None] Lock "cinder-98b0cdf2-bc3a-4fc3-ad0f-c3703cbb465f-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:33 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c" returned: 0 in 0.451s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.462s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-a9b45131-25f9-4fbd-85ec-7d7e398b55a2-705b1274-65b7-46c5-93ab-e3120bd265df" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3433ddea-7fcd-46b4-ab67-3e199fa79392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20807988-6942-4cf7-a47f-ba94db7a9b8c', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3213849-7788-4d37-8eb0-9da26e5f9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-a9b45131-25f9-4fbd-85ec-7d7e398b55a2-705b1274-65b7-46c5-93ab-e3120bd265df" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Creating volume 705b1274-65b7-46c5-93ab-e3120bd265df from snapshot a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-705b1274-65b7-46c5-93ab-e3120bd265df" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:33 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Volume volume-20807988-6942-4cf7-a47f-ba94db7a9b8c (20807988-6942-4cf7-a47f-ba94db7a9b8c): created successfully
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3213849-7788-4d37-8eb0-9da26e5f9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Flow 'volume_create_manager' (5b3dfd54-6629-425e-81b9-5f7715513511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-705b1274-65b7-46c5-93ab-e3120bd265df" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] snapshot: a9b45131-25f9-4fbd-85ec-7d7e398b55a2, volume: 705b1274-65b7-46c5-93ab-e3120bd265df,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:44:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-abf48949-b967-4d34-933b-4932439d2314 tempest-VolumesServicesTestJSON-764039279 None] Created volume successfully.
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad85ec34-638b-4db3-b627-9bb393e28dd7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:34 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2
Apr 20 18:44:34 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Acquiring lock "cinder-20807988-6942-4cf7-a47f-ba94db7a9b8c-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Lock "cinder-20807988-6942-4cf7-a47f-ba94db7a9b8c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Acquiring lock "cinder-quobyte-20807988-6942-4cf7-a47f-ba94db7a9b8c" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Lock "cinder-quobyte-20807988-6942-4cf7-a47f-ba94db7a9b8c" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[99753368-4607-4d46-a3de-abb3d3594098]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:34 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c
Apr 20 18:44:34 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:34 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[934efe05-0db0-49ec-95aa-5d92106213ae]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:34 devstack sudo[89320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:34 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:34 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c" returned: 0 in 0.457s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:34 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c
Apr 20 18:44:34 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:34 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.495s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:44:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:34 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df
Apr 20 18:44:34 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:35 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20807988-6942-4cf7-a47f-ba94db7a9b8c" returned: 0 in 0.405s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Lock "cinder-quobyte-20807988-6942-4cf7-a47f-ba94db7a9b8c" released by "delete_volume" :: held 0.886s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Created reservations ['815730ef-11f7-43e0-aaed-c9f49430d7c7', 'f74cf926-18cc-4bf8-a142-d1c1bf4bee29', 'b05fa535-a35f-4aa9-8e7c-250baa674bda', '500a797b-cb94-4e18-af6e-c19fdb91ee4f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:35 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:35 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:36 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.406s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:36 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Deleted volume successfully.
Apr 20 18:44:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8d2ebf32-1494-4ec2-8684-8e16d6808702 tempest-VolumesServicesTestJSON-764039279 None] Lock "cinder-20807988-6942-4cf7-a47f-ba94db7a9b8c-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:36 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df" returned: 0 in 2.071s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:37 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba6602a-5f70-483e-95ad-b3aa09878264]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:37 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:37 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:37 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.673s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:37 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:44:37 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Converted 1024.00 MB image at 494.26 MB/s
Apr 20 18:44:37 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df is being set with open permissions: ugo+rw
Apr 20 18:44:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:37 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df
Apr 20 18:44:37 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:38 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df" returned: 0 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-705b1274-65b7-46c5-93ab-e3120bd265df" released by "_copy_volume_from_snapshot" :: held 4.226s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-a9b45131-25f9-4fbd-85ec-7d7e398b55a2-705b1274-65b7-46c5-93ab-e3120bd265df" released by "_create_volume_from_snapshot" :: held 4.254s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.272s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a7295b-820e-468b-9b61-bfc302427597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705b1274-65b7-46c5-93ab-e3120bd265df', 'volume_size': 1, 'snapshot_id': 'a9b45131-25f9-4fbd-85ec-7d7e398b55a2'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eab0055-d2d0-46f0-8ae4-17a83b9ae8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:38 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Volume volume-705b1274-65b7-46c5-93ab-e3120bd265df (705b1274-65b7-46c5-93ab-e3120bd265df): created successfully
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eab0055-d2d0-46f0-8ae4-17a83b9ae8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (52f62edd-54ee-4c92-886d-01a624888949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0454191e-5559-40d1-8e41-13d173ae5bbd tempest-VolumeDependencyTests-2141591752 None] Created volume successfully.
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-a9b45131-25f9-4fbd-85ec-7d7e398b55a2-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-a9b45131-25f9-4fbd-85ec-7d7e398b55a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-a9b45131-25f9-4fbd-85ec-7d7e398b55a2" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-a9b45131-25f9-4fbd-85ec-7d7e398b55a2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Deleting offline snapshot a9b45131-25f9-4fbd-85ec-7d7e398b55a2 of volume 034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] snapshot_file for this snap is: volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed477df-09e1-44b9-b068-529413a577ed]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:38 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2
Apr 20 18:44:38 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:39 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2" returned: 0 in 0.486s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:39 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[86909804-57df-47e5-b774-3858a7156fc7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:39 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:39 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:39 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.536s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:39 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2
Apr 20 18:44:39 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:40 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2" returned: 0 in 0.467s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:40 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2
Apr 20 18:44:40 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:40 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6.a9b45131-25f9-4fbd-85ec-7d7e398b55a2" returned: 0 in 0.455s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-a9b45131-25f9-4fbd-85ec-7d7e398b55a2" released by "_delete_snapshot" :: held 2.001s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" released by "delete_snapshot" :: held 2.016s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Created reservations ['8b07e3c8-7771-4c0c-be76-34f26b9773cd', '52ab158d-0400-4c51-a2a7-c894b525e479', 'c9966d68-e020-4f55-83de-2b8e6d6e14d5', '1fe70167-8c4c-4d27-9f40-7b2603eda8f8'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:40 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Delete snapshot completed successfully.
Apr 20 18:44:40 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-77034367-5af7-4a86-b8da-8b10c55d51f8 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-a9b45131-25f9-4fbd-85ec-7d7e398b55a2-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-034714d8-92a0-4cc5-b108-f0b78ca4a2d6-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-034714d8-92a0-4cc5-b108-f0b78ca4a2d6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:41 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c72407d-a886-4655-9a0f-257423157ffb]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:42 devstack sudo[89377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:42 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Flow 'volume_create_manager' (62ad8631-b1d0-4362-9c10-f1a54692ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10cd4ff-9230-4578-8d74-8b6d33b765c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10cd4ff-9230-4578-8d74-8b6d33b765c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118053402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c8006203d45fa8e88dbef543e12af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:42Z,use_quota=True,user_id='c2a9ffa14cee4336be402a4b4e3a7e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6afb7-0ec5-4518-ab7a-8b82fa45a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6afb7-0ec5-4518-ab7a-8b82fa45a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da43b93a-a0c6-4670-97e4-165e71ab6069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da43b93a-a0c6-4670-97e4-165e71ab6069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8', 'volume_name': 'volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7946d0-e778-4e42-8bb5-35aebccb5efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7946d0-e778-4e42-8bb5-35aebccb5efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c97d8d0-cb25-4c7f-ab9d-d3c23b3b97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:42 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Volume 07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8', 'volume_size': 1}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118053402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c8006203d45fa8e88dbef543e12af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:42Z,use_quota=True,user_id='c2a9ffa14cee4336be402a4b4e3a7e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Creating volume 07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:42 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:42 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 1073741824
Apr 20 18:44:42 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:42 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:42 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6
Apr 20 18:44:42 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:42 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 1073741824" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:42 devstack sudo[89390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8
Apr 20 18:44:42 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:42 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" returned: 0 in 0.437s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-034714d8-92a0-4cc5-b108-f0b78ca4a2d6" released by "delete_volume" :: held 0.947s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Created reservations ['ec039a13-237c-4693-b05a-d05c373dd12c', 'b82b2c4b-07d4-457b-84b3-f5e1ff780e6c', '2c2697ba-9bc2-4eb2-86c9-4315c459962d', '8c600ad5-1a58-471a-add6-9f78f10dec4e'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:43 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:43 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (0a9d5df5-6508-4444-91aa-a014d8e1842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eb79b4-8375-4a1a-9854-383f0ea32e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:43 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39eb79b4-8375-4a1a-9854-383f0ea32e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-861731371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93df04ad-b941-40ac-93f2-f1c6bf31d208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc2cebf850f485d9907c784fbac7a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:43Z,use_quota=True,user_id='e1ce4b0d1e90432c93ee76c1e8f9d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d027bd0-676e-491d-a37d-1f5881f5995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d027bd0-676e-491d-a37d-1f5881f5995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbecac1c-9afd-4090-ae23-11421630ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbecac1c-9afd-4090-ae23-11421630ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93df04ad-b941-40ac-93f2-f1c6bf31d208', 'volume_name': 'volume-93df04ad-b941-40ac-93f2-f1c6bf31d208', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500be0a0-eff8-480e-819b-eb087a612f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500be0a0-eff8-480e-819b-eb087a612f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc974de1-988e-4b90-8063-c5ff77391266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:43 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Volume 93df04ad-b941-40ac-93f2-f1c6bf31d208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93df04ad-b941-40ac-93f2-f1c6bf31d208', 'volume_size': 1}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-861731371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93df04ad-b941-40ac-93f2-f1c6bf31d208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc2cebf850f485d9907c784fbac7a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:43Z,use_quota=True,user_id='e1ce4b0d1e90432c93ee76c1e8f9d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Creating volume 93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:43 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c97d8d0-cb25-4c7f-ab9d-d3c23b3b97f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:43 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 1073741824
Apr 20 18:44:43 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3908be6-c619-4447-9523-178bdc6932f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:43 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Volume volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 (07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8): created successfully
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3908be6-c619-4447-9523-178bdc6932f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Flow 'volume_create_manager' (62ad8631-b1d0-4362-9c10-f1a54692ce99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c675d0ea-0579-4dc0-bc24-2f95401f3ec0 tempest-VolumesListAdminTestJSON-1701776302 None] Created volume successfully.
Apr 20 18:44:43 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Deleted volume successfully.
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-accf289a-4c97-4372-bc51-f6fcbdd0da3f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-034714d8-92a0-4cc5-b108-f0b78ca4a2d6-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:43 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 1073741824" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:43 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:43 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:44 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.398s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc974de1-988e-4b90-8063-c5ff77391266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93df04ad-b941-40ac-93f2-f1c6bf31d208', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb6b06d-7c12-45bf-a16a-4ac32a01b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:44 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Volume volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 (93df04ad-b941-40ac-93f2-f1c6bf31d208): created successfully
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb6b06d-7c12-45bf-a16a-4ac32a01b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (0a9d5df5-6508-4444-91aa-a014d8e1842c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:44 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-acff45ef-b550-4816-b75f-803b627626c9 tempest-VolumeDependencyTests-2141591752 None] Created volume successfully.
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Flow 'volume_create_manager' (b9443203-bd0d-4350-9bc3-ad6375b63fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c63799-4cce-4809-8bfa-302cc98386af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c63799-4cce-4809-8bfa-302cc98386af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-138379277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92264887-24af-48e3-82b7-02f97ec303c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c8006203d45fa8e88dbef543e12af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:45Z,use_quota=True,user_id='c2a9ffa14cee4336be402a4b4e3a7e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb02541d-67e1-4308-8958-803bcfb0dd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb02541d-67e1-4308-8958-803bcfb0dd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd487be4-2139-4036-9e55-4ffbde5a73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd487be4-2139-4036-9e55-4ffbde5a73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92264887-24af-48e3-82b7-02f97ec303c6', 'volume_name': 'volume-92264887-24af-48e3-82b7-02f97ec303c6', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9f2e21-6b94-4717-8c0d-a459203d350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9f2e21-6b94-4717-8c0d-a459203d350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ec856c-5b81-43ca-b4db-e4179789b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:44 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Volume 92264887-24af-48e3-82b7-02f97ec303c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92264887-24af-48e3-82b7-02f97ec303c6', 'volume_size': 1}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-138379277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92264887-24af-48e3-82b7-02f97ec303c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c8006203d45fa8e88dbef543e12af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:45Z,use_quota=True,user_id='c2a9ffa14cee4336be402a4b4e3a7e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Creating volume 92264887-24af-48e3-82b7-02f97ec303c6 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:44 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:44 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6 1073741824
Apr 20 18:44:44 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:45 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6 1073741824" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:45 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6
Apr 20 18:44:45 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:45 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (7237a5d3-056c-48ca-887a-64eac144da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3561ec65-6b96-41bf-ba5e-133f897b6fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6" returned: 0 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3561ec65-6b96-41bf-ba5e-133f897b6fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-699143953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98070758-87f2-4097-a932-e39372d34a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc2cebf850f485d9907c784fbac7a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=93df04ad-b941-40ac-93f2-f1c6bf31d208,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:46Z,use_quota=True,user_id='e1ce4b0d1e90432c93ee76c1e8f9d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1bec9a-c961-419c-a0f9-3d95b9092263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1bec9a-c961-419c-a0f9-3d95b9092263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79606fa-f322-48f2-b99e-fbf5651fbd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79606fa-f322-48f2-b99e-fbf5651fbd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '98070758-87f2-4097-a932-e39372d34a58', 'volume_name': 'volume-98070758-87f2-4097-a932-e39372d34a58', 'volume_size': 1, 'source_volid': '93df04ad-b941-40ac-93f2-f1c6bf31d208', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dbe3b9-f2dd-4adf-b858-58b6c0992716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67dbe3b9-f2dd-4adf-b858-58b6c0992716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db411cb6-9468-4c7b-8ea1-d0479181a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:45 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Volume 98070758-87f2-4097-a932-e39372d34a58: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-98070758-87f2-4097-a932-e39372d34a58', 'volume_size': 1, 'source_volid': '93df04ad-b941-40ac-93f2-f1c6bf31d208', 'source_volstatus': 'available'}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:45 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Cloning volume 93df04ad-b941-40ac-93f2-f1c6bf31d208 to volume 98070758-87f2-4097-a932-e39372d34a58
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ec856c-5b81-43ca-b4db-e4179789b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92264887-24af-48e3-82b7-02f97ec303c6', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0233bd-09bc-4b4f-a246-2a1db10c26be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:45 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Volume volume-92264887-24af-48e3-82b7-02f97ec303c6 (92264887-24af-48e3-82b7-02f97ec303c6): created successfully
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0233bd-09bc-4b4f-a246-2a1db10c26be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Flow 'volume_create_manager' (b9443203-bd0d-4350-9bc3-ad6375b63fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:45 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6257741f-48b1-4a10-8795-3a273fca1228 tempest-VolumesListAdminTestJSON-1701776302 None] Created volume successfully.
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Creating offline snapshot fb53e09a-6412-4485-b80c-a2a2ba0914e1 of volume 93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9fd6a8-fe09-46e1-81fb-43c74e2d49c1]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:45 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:45 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:46 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.463s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:46 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 1G
Apr 20 18:44:46 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:46 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 1G" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:46 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1
Apr 20 18:44:46 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Flow 'volume_create_manager' (6aacc535-df85-403c-bd92-eee9c4f26e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d570433c-49dc-4208-a726-b5a209f30fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d570433c-49dc-4208-a726-b5a209f30fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-454360175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f74264-9694-4a7f-895f-5a592c0843b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c8006203d45fa8e88dbef543e12af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:47Z,use_quota=True,user_id='c2a9ffa14cee4336be402a4b4e3a7e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb21739-4073-47d7-b991-fa45c5044e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb21739-4073-47d7-b991-fa45c5044e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d23aec6-b912-4aab-a90a-3b0bdb6fc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d23aec6-b912-4aab-a90a-3b0bdb6fc007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f74264-9694-4a7f-895f-5a592c0843b8', 'volume_name': 'volume-d6f74264-9694-4a7f-895f-5a592c0843b8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e40ab2-b692-42b2-9a2f-c38ad703bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e40ab2-b692-42b2-9a2f-c38ad703bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe414c2-a081-4996-8295-0ae143ebe3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:47 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Volume d6f74264-9694-4a7f-895f-5a592c0843b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f74264-9694-4a7f-895f-5a592c0843b8', 'volume_size': 1}
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:47 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:47 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 is being set with open permissions: ugo+rw
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:47 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1
Apr 20 18:44:47 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:47 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1" returned: 0 in 0.405s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:47 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info
Apr 20 18:44:47 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:47 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info" returned: 0 in 0.423s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:48 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info is being set with open permissions: ugo+rw
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:48 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info
Apr 20 18:44:48 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:48 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.info" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-98070758-87f2-4097-a932-e39372d34a58" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-98070758-87f2-4097-a932-e39372d34a58" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] snapshot: fb53e09a-6412-4485-b80c-a2a2ba0914e1, volume: 98070758-87f2-4097-a932-e39372d34a58,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e43af3-e6fe-40b4-8141-b724b1bd54f3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:48 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1
Apr 20 18:44:48 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:48 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1" returned: 0 in 0.455s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93df04ad-b941-40ac-93f2-f1c6bf31d208(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0251bec5-3853-4b6c-997d-9577f5569503]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:48 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:48 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:49 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:49 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:44:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:49 devstack sudo[89448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58
Apr 20 18:44:49 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:51 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58" returned: 0 in 1.953s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ed4fd-d278-47ec-a730-3fe48b6e70e8]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:51 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:51 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:51 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.593s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:51 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:44:51 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Converted 1024.00 MB image at 524.05 MB/s
Apr 20 18:44:51 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 is being set with open permissions: ugo+rw
Apr 20 18:44:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:51 devstack sudo[89466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58
Apr 20 18:44:51 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:52 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58" returned: 0 in 0.406s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-98070758-87f2-4097-a932-e39372d34a58" released by "_copy_volume_from_snapshot" :: held 3.903s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-fb53e09a-6412-4485-b80c-a2a2ba0914e1" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-fb53e09a-6412-4485-b80c-a2a2ba0914e1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Deleting offline snapshot fb53e09a-6412-4485-b80c-a2a2ba0914e1 of volume 93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] snapshot_file for this snap is: volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31017c9-370e-4eda-bc71-f4e14c96d217]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:52 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1
Apr 20 18:44:52 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:52 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93df04ad-b941-40ac-93f2-f1c6bf31d208(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e4d45a-67c2-4dd8-a862-95be6625b4f9]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:52 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:52 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:53 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:53 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1
Apr 20 18:44:53 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:53 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1" returned: 0 in 0.430s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:53 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1
Apr 20 18:44:53 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:54 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208.fb53e09a-6412-4485-b80c-a2a2ba0914e1" returned: 0 in 0.409s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-fb53e09a-6412-4485-b80c-a2a2ba0914e1" released by "_delete_snapshot" :: held 1.818s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.491s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.173s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-454360175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f74264-9694-4a7f-895f-5a592c0843b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='021c8006203d45fa8e88dbef543e12af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:47Z,use_quota=True,user_id='c2a9ffa14cee4336be402a4b4e3a7e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Creating volume d6f74264-9694-4a7f-895f-5a592c0843b8 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:54 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db411cb6-9468-4c7b-8ea1-d0479181a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98070758-87f2-4097-a932-e39372d34a58', 'volume_size': 1, 'source_volid': '93df04ad-b941-40ac-93f2-f1c6bf31d208', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3abc6f-ad28-4c34-a9af-3fdb35827e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:54 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8 1073741824
Apr 20 18:44:54 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:54 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Volume volume-98070758-87f2-4097-a932-e39372d34a58 (98070758-87f2-4097-a932-e39372d34a58): created successfully
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3abc6f-ad28-4c34-a9af-3fdb35827e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Flow 'volume_create_manager' (7237a5d3-056c-48ca-887a-64eac144da0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:54 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f5e990a6-9c13-4de7-97d1-2e22c8afa53f tempest-VolumeDependencyTests-2141591752 None] Created volume successfully.
Apr 20 18:44:54 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8 1073741824" returned: 0 in 0.481s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:54 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8
Apr 20 18:44:54 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-93df04ad-b941-40ac-93f2-f1c6bf31d208-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-93df04ad-b941-40ac-93f2-f1c6bf31d208-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:55 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8" returned: 0 in 0.439s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-93df04ad-b941-40ac-93f2-f1c6bf31d208" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe414c2-a081-4996-8295-0ae143ebe3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f74264-9694-4a7f-895f-5a592c0843b8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8cd239-358b-47f5-b7a1-b39dc0f8a86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-93df04ad-b941-40ac-93f2-f1c6bf31d208" acquired by "delete_volume" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Volume volume-d6f74264-9694-4a7f-895f-5a592c0843b8 (d6f74264-9694-4a7f-895f-5a592c0843b8): created successfully
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8cd239-358b-47f5-b7a1-b39dc0f8a86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Flow 'volume_create_manager' (6aacc535-df85-403c-bd92-eee9c4f26e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a36625-e4ce-4ac2-acdf-bb464cbb5191]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-29ce8981-b10c-42ed-a959-d9427024c01f tempest-VolumesListAdminTestJSON-1701776302 None] Created volume successfully.
Apr 20 18:44:55 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:55 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Flow 'volume_create_manager' (e930bf3f-4a8c-4f95-b6e0-0cce48f1f828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:55 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238c9467-31de-42ec-a857-4f25110fbbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238c9467-31de-42ec-a857-4f25110fbbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2957c05a-f29d-45e2-907a-e2dabc745bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49adb203dee425cb5d6cf8e7a65d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:56Z,use_quota=True,user_id='3237aa2210394663bfabd6a713287938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97d89a3-4ae3-46e8-8845-893906dc5b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97d89a3-4ae3-46e8-8845-893906dc5b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706c3ea5-cb9d-453b-b348-18bfeb6b0072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706c3ea5-cb9d-453b-b348-18bfeb6b0072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2957c05a-f29d-45e2-907a-e2dabc745bf5', 'volume_name': 'volume-2957c05a-f29d-45e2-907a-e2dabc745bf5', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5647fd4-3947-4ee9-84dc-1f0057d21c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5647fd4-3947-4ee9-84dc-1f0057d21c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ed967c-21bb-4614-a189-459b611f085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Volume 2957c05a-f29d-45e2-907a-e2dabc745bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2957c05a-f29d-45e2-907a-e2dabc745bf5', 'volume_size': 1}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2957c05a-f29d-45e2-907a-e2dabc745bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49adb203dee425cb5d6cf8e7a65d216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:44:56Z,use_quota=True,user_id='3237aa2210394663bfabd6a713287938',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Creating volume 2957c05a-f29d-45e2-907a-e2dabc745bf5 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:44:55 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.540s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:55 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 1073741824
Apr 20 18:44:55 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:55 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208
Apr 20 18:44:55 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:56 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93df04ad-b941-40ac-93f2-f1c6bf31d208" returned: 0 in 0.422s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-93df04ad-b941-40ac-93f2-f1c6bf31d208" released by "delete_volume" :: held 1.002s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Created reservations ['c747dd2a-a639-4b71-9877-d35a5b4ec4eb', '0b83f513-9f90-4ef3-bf15-b3693cfc3f2c', 'c1d06e93-0edb-41b6-ac4f-e607ab9f3eb7', 'd1173dfc-1680-4ebb-be76-8bf3e2be6e69'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:56 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 1073741824" returned: 0 in 0.491s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:56 devstack sudo[89508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:56 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:56 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:56 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:56 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5" returned: 0 in 0.408s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ed967c-21bb-4614-a189-459b611f085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2957c05a-f29d-45e2-907a-e2dabc745bf5', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:56 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85432c75-b4ff-42b0-847f-7a828d5ab1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.412s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:56 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Volume volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 (2957c05a-f29d-45e2-907a-e2dabc745bf5): created successfully
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85432c75-b4ff-42b0-847f-7a828d5ab1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Flow 'volume_create_manager' (e930bf3f-4a8c-4f95-b6e0-0cce48f1f828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:44:56 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Deleted volume successfully.
Apr 20 18:44:56 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4865936e-3c79-4a54-b592-78289ca8be14 tempest-VolumesListAdminTestJSON-1278237710 None] Created volume successfully.
Apr 20 18:44:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-526a2420-7570-458f-96e3-c2191c1b3ed9 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-93df04ad-b941-40ac-93f2-f1c6bf31d208-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-98070758-87f2-4097-a932-e39372d34a58-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-98070758-87f2-4097-a932-e39372d34a58-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-98070758-87f2-4097-a932-e39372d34a58" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-98070758-87f2-4097-a932-e39372d34a58" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9326589a-d2a6-40f9-8e5f-67c48f74b277]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:57 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58
Apr 20 18:44:57 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:57 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:57 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58
Apr 20 18:44:57 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Acquiring lock "cinder-2957c05a-f29d-45e2-907a-e2dabc745bf5-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "cinder-2957c05a-f29d-45e2-907a-e2dabc745bf5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Acquiring lock "cinder-quobyte-2957c05a-f29d-45e2-907a-e2dabc745bf5" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "cinder-quobyte-2957c05a-f29d-45e2-907a-e2dabc745bf5" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d16c7d-28dd-4047-9a9a-dcda652f1b06]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "cinder-d6f74264-9694-4a7f-895f-5a592c0843b8-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-d6f74264-9694-4a7f-895f-5a592c0843b8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "cinder-quobyte-d6f74264-9694-4a7f-895f-5a592c0843b8" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:57 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5
Apr 20 18:44:57 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-quobyte-d6f74264-9694-4a7f-895f-5a592c0843b8" acquired by "delete_volume" :: waited 0.024s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f1d20-6b77-4efe-83df-6a75cce825c5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:58 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8
Apr 20 18:44:58 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:58 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-98070758-87f2-4097-a932-e39372d34a58" returned: 0 in 0.442s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-98070758-87f2-4097-a932-e39372d34a58" released by "delete_volume" :: held 0.964s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Created reservations ['96a1267b-f60e-4f67-87f2-0e79904560ba', '0c1a68ec-6d7a-4078-a374-c6b306745e27', 'c8cda28e-3606-41f8-a3fb-983fd40021c5', 'bc2e8186-fdfe-4b67-b6c7-937ab1f99572'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:58 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:58 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-705b1274-65b7-46c5-93ab-e3120bd265df-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:58 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5" returned: 0 in 0.526s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-705b1274-65b7-46c5-93ab-e3120bd265df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:58 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5
Apr 20 18:44:58 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=204,cinder:INSERT=68,cinder:UPDATE=274,cinder:DELETE=25 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "cinder-quobyte-705b1274-65b7-46c5-93ab-e3120bd265df" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-705b1274-65b7-46c5-93ab-e3120bd265df" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f5b6c1-78d6-4467-9b5c-c97c6cb95f9d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:58 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8" returned: 0 in 0.532s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:58 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8
Apr 20 18:44:58 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:58 devstack sudo[89536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df
Apr 20 18:44:58 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:58 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:58 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Deleted volume successfully.
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-94a8e00f-e11c-4055-b61c-d96a73d4264f tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-98070758-87f2-4097-a932-e39372d34a58-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:58 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2957c05a-f29d-45e2-907a-e2dabc745bf5" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "cinder-quobyte-2957c05a-f29d-45e2-907a-e2dabc745bf5" released by "delete_volume" :: held 1.017s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=200,cinder:INSERT=68,cinder:UPDATE=287,cinder:DELETE=20 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Created reservations ['9a57c1f9-086c-49a5-bfaf-f139c5249a2c', '07c21b5a-b7ff-4d2c-bd5e-0cc2af8fedfe', '5539753a-9793-4b89-856b-954fee9d9d1c', '2eb59b1b-db0a-4234-b840-6d3806807e8a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:58 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-d6f74264-9694-4a7f-895f-5a592c0843b8" returned: 0 in 0.428s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-quobyte-d6f74264-9694-4a7f-895f-5a592c0843b8" released by "delete_volume" :: held 0.981s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:59 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:59 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:59 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df" returned: 0 in 0.513s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:59 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df
Apr 20 18:44:59 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Created reservations ['fc553750-7ab3-498e-907e-5657726857cc', '40b16a97-73d5-47b7-a122-0f285305ff30', '607d0a78-9146-47b0-8fdf-600bb3955f19', '257b8a73-5fc3-489e-8749-77494aa59de4'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:59 devstack sudo[89550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:59 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:59 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.426s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Deleted volume successfully.
Apr 20 18:44:59 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-705b1274-65b7-46c5-93ab-e3120bd265df" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-db191c63-57d7-456f-b44d-9412128720c0 tempest-VolumesListAdminTestJSON-1278237710 None] Lock "cinder-2957c05a-f29d-45e2-907a-e2dabc745bf5-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-quobyte-705b1274-65b7-46c5-93ab-e3120bd265df" released by "delete_volume" :: held 0.949s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Created reservations ['00ad96e8-1919-4ec2-9322-339349b2410e', 'b4f72eee-4eb5-4d92-9384-46bfc89b5212', '5f192c4e-1bf5-4954-a6a8-ac6f2be60752', '77a9ada3-cb19-46d4-b5c6-e51a5f98fced'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:44:59 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.437s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:44:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Deleted volume successfully.
Apr 20 18:44:59 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:44:59 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:44:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-1b6f31db-46b7-4959-b61a-7a9dc21cbbc4 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-d6f74264-9694-4a7f-895f-5a592c0843b8-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:00 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Deleted volume successfully.
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e6d3dd91-88cc-4bfe-b9bc-e593f9238334 tempest-VolumeDependencyTests-2141591752 None] Lock "cinder-705b1274-65b7-46c5-93ab-e3120bd265df-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "cinder-92264887-24af-48e3-82b7-02f97ec303c6-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-92264887-24af-48e3-82b7-02f97ec303c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "cinder-quobyte-92264887-24af-48e3-82b7-02f97ec303c6" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-quobyte-92264887-24af-48e3-82b7-02f97ec303c6" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[893b6ee4-06fb-494e-937e-4f6c4f7f52f4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:00 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6
Apr 20 18:45:00 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:00 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6" returned: 0 in 0.504s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:00 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6
Apr 20 18:45:00 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:01 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-92264887-24af-48e3-82b7-02f97ec303c6" returned: 0 in 0.399s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-quobyte-92264887-24af-48e3-82b7-02f97ec303c6" released by "delete_volume" :: held 0.934s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Created reservations ['b90e48e6-4c69-4972-9b0d-2019bbca531a', 'b6cf580c-b9cb-4896-9372-e071b1fcb9a4', '3802f5c5-df59-46d8-a9b1-1a0e16f45f1e', '7c42bcb8-e189-478e-9ada-6a859ca8b2a7'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:01 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:01 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "cinder-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "cinder-quobyte-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-quobyte-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fce20e-b247-4e8a-b942-0f371fc48be1]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:01 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8
Apr 20 18:45:01 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:01 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.442s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Deleted volume successfully.
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-dc5aaf54-095d-4d30-8426-81881e234769 tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-92264887-24af-48e3-82b7-02f97ec303c6-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:01 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:01 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8
Apr 20 18:45:01 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:02 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8" returned: 0 in 0.398s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-quobyte-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8" released by "delete_volume" :: held 0.892s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Created reservations ['b6c49714-6b26-4fa4-8c80-30693bee9002', 'f4233f26-0e7b-4263-b8aa-748ec73f1177', '66b3036f-54bf-4cee-b8b8-069c5a3acbc1', '2f599c83-12f9-4ec9-b49c-326f155fa5ee'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:02 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:02 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:02 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.443s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Deleted volume successfully.
Apr 20 18:45:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ff719380-5ff7-4784-9dad-96e6664f962a tempest-VolumesListAdminTestJSON-1701776302 None] Lock "cinder-07fdc9c5-1e0e-4970-a629-cf77ceb9a4d8-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Flow 'volume_create_manager' (45ed0c6d-f74f-477b-b48e-caa0d0520b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53292b1-6f42-4abd-b038-276b9eaadb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53292b1-6f42-4abd-b038-276b9eaadb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1428161434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f6d2a9-03e1-4ea6-b407-d7435a5624eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed80e4e1bdab4bea8bcd22cd1c760dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:05Z,use_quota=True,user_id='ca95e3da6ee04aabaf2674df5bdc1003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ddf75f-b075-47b8-bfe1-22ebf6775b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ddf75f-b075-47b8-bfe1-22ebf6775b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd95e86f-b008-4fac-bf62-f1a29e2bfd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd95e86f-b008-4fac-bf62-f1a29e2bfd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f6d2a9-03e1-4ea6-b407-d7435a5624eb', 'volume_name': 'volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15e858b-6f38-43bd-a380-833b66e2af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15e858b-6f38-43bd-a380-833b66e2af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7787d0-f634-4042-879a-9bb52f873ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Volume f6f6d2a9-03e1-4ea6-b407-d7435a5624eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb', 'volume_size': 1}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1428161434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f6d2a9-03e1-4ea6-b407-d7435a5624eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed80e4e1bdab4bea8bcd22cd1c760dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:05Z,use_quota=True,user_id='ca95e3da6ee04aabaf2674df5bdc1003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Creating volume f6f6d2a9-03e1-4ea6-b407-d7435a5624eb {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:45:05 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:45:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:05 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb 1073741824
Apr 20 18:45:05 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:06 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb 1073741824" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:06 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb
Apr 20 18:45:06 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:06 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb" returned: 0 in 0.409s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7787d0-f634-4042-879a-9bb52f873ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56946c85-578c-4667-8f46-5f9b56c3097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:06 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Volume volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb (f6f6d2a9-03e1-4ea6-b407-d7435a5624eb): created successfully
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56946c85-578c-4667-8f46-5f9b56c3097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Flow 'volume_create_manager' (45ed0c6d-f74f-477b-b48e-caa0d0520b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-69854fb2-c3d2-4f3d-9158-170ca4f2cb83 tempest-AbsoluteLimitsTests-1985848340 None] Created volume successfully.
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Acquiring lock "cinder-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Lock "cinder-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Acquiring lock "cinder-quobyte-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Lock "cinder-quobyte-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[758fedbd-0569-4ebf-b892-e85952ee9df6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:06 devstack sudo[89590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb
Apr 20 18:45:06 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:07 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb" returned: 0 in 0.461s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:07 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb
Apr 20 18:45:07 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:07 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb" returned: 0 in 0.412s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Lock "cinder-quobyte-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb" released by "delete_volume" :: held 0.894s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Created reservations ['e1a9403f-a6a5-4411-800d-9a9d4e8f95d3', 'e4aaeafe-22a1-42a3-9e2f-93a0d9fd04cd', 'e97ff2c5-7dc5-496f-81e2-5c6e243ef069', 'be966836-ed61-427e-a114-adc86ade5819'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:07 devstack sudo[89598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:07 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:08 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.484s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:08 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:08 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Deleted volume successfully.
Apr 20 18:45:08 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-ba6f5c5b-4065-4a19-84b9-ed9c41c44ec3 tempest-AbsoluteLimitsTests-1985848340 None] Lock "cinder-f6f6d2a9-03e1-4ea6-b407-d7435a5624eb-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Flow 'volume_create_manager' (fca8a290-bf87-42a9-bf57-c6db334074b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d0afd0-f5fb-4898-88ca-8f0a6bfad1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d0afd0-f5fb-4898-88ca-8f0a6bfad1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1336043641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f26842-a5a2-4320-9d34-e8ac1bc78662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2ee4efd974eeca71dc7a53e48331c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:11Z,use_quota=True,user_id='9b606ad1bd1343f9a4f03352e472cd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32acf6c4-c21b-4ee6-bb68-2d91b77a135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32acf6c4-c21b-4ee6-bb68-2d91b77a135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa710d3-4e0c-4a7f-984e-03d155e5f3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa710d3-4e0c-4a7f-984e-03d155e5f3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f26842-a5a2-4320-9d34-e8ac1bc78662', 'volume_name': 'volume-31f26842-a5a2-4320-9d34-e8ac1bc78662', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e304ffa-3038-43f7-8f37-579ef62a7233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e304ffa-3038-43f7-8f37-579ef62a7233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7c547c-bca9-408c-a06b-2ea0b815fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:10 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Volume 31f26842-a5a2-4320-9d34-e8ac1bc78662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f26842-a5a2-4320-9d34-e8ac1bc78662', 'volume_size': 1}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1336043641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f26842-a5a2-4320-9d34-e8ac1bc78662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2ee4efd974eeca71dc7a53e48331c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:11Z,use_quota=True,user_id='9b606ad1bd1343f9a4f03352e472cd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Creating volume 31f26842-a5a2-4320-9d34-e8ac1bc78662 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:45:10 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:45:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:10 devstack sudo[89608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 1073741824
Apr 20 18:45:10 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:11 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 1073741824" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:11 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662
Apr 20 18:45:11 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:11 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662" returned: 0 in 0.401s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7c547c-bca9-408c-a06b-2ea0b815fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f26842-a5a2-4320-9d34-e8ac1bc78662', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74a357e-2bc9-46f3-90ac-2428feaab1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:11 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Volume volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 (31f26842-a5a2-4320-9d34-e8ac1bc78662): created successfully
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74a357e-2bc9-46f3-90ac-2428feaab1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:11 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Flow 'volume_create_manager' (fca8a290-bf87-42a9-bf57-c6db334074b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:11 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ae75ea10-98e9-4482-8e4b-8c07a96e1f1f tempest-VolumesTransfersTest-234096276 None] Created volume successfully.
Apr 20 18:45:12 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-f1787517-e72e-46a8-9b5b-1280a3279467 tempest-VolumesTransfersTest-839156390 None] Transfer volume completed successfully.
Apr 20 18:45:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Acquiring lock "cinder-31f26842-a5a2-4320-9d34-e8ac1bc78662-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-31f26842-a5a2-4320-9d34-e8ac1bc78662-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Acquiring lock "cinder-quobyte-31f26842-a5a2-4320-9d34-e8ac1bc78662" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-quobyte-31f26842-a5a2-4320-9d34-e8ac1bc78662" acquired by "delete_volume" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:12 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[22902de0-cf4b-4421-8838-6d3f035b8b9a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:13 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662
Apr 20 18:45:13 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:13 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662" returned: 0 in 0.463s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:13 devstack sudo[89621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662
Apr 20 18:45:13 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:13 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-31f26842-a5a2-4320-9d34-e8ac1bc78662" returned: 0 in 0.405s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-quobyte-31f26842-a5a2-4320-9d34-e8ac1bc78662" released by "delete_volume" :: held 0.889s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Created reservations ['75c3055e-fc97-40d3-ad15-5c83d582e656', 'ba24a506-61c0-45ab-9019-1252be711cdc', '6a6b8e3a-6af0-4697-abd7-7a79bca7e528', '3c1995b2-a69c-4ff2-9745-cec71ec8f6be'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:13 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:13 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Flow 'volume_create_manager' (28aa89b4-38fe-49e8-ab12-63fcc0752ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334a2ee6-841b-4c3d-8af4-b516051ad449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334a2ee6-841b-4c3d-8af4-b516051ad449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1579988912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2ee4efd974eeca71dc7a53e48331c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:14Z,use_quota=True,user_id='9b606ad1bd1343f9a4f03352e472cd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9feb1a-2035-4f2b-b9cc-0eb2a3c0468b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9feb1a-2035-4f2b-b9cc-0eb2a3c0468b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d4422c-b0a2-46a5-9ac8-e12940039a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d4422c-b0a2-46a5-9ac8-e12940039a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac', 'volume_name': 'volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab0a3c6-fca6-4a25-b670-fd86670057e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab0a3c6-fca6-4a25-b670-fd86670057e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82abd16a-1197-45b7-9a32-25ab7cd5f911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:14 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Volume 6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac', 'volume_size': 1}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1579988912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba2ee4efd974eeca71dc7a53e48331c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:14Z,use_quota=True,user_id='9b606ad1bd1343f9a4f03352e472cd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Creating volume 6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:45:14 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:14 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac 1073741824
Apr 20 18:45:14 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:14 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.490s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Deleted volume successfully.
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fdce0b4e-5e97-4b50-8325-a73bdd002e20 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-31f26842-a5a2-4320-9d34-e8ac1bc78662-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:14 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac 1073741824" returned: 0 in 0.474s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:14 devstack sudo[89632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac
Apr 20 18:45:14 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:15 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac" returned: 0 in 0.407s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82abd16a-1197-45b7-9a32-25ab7cd5f911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7581d9e-3a66-417d-864d-e06d338f8816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:15 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Volume volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac (6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac): created successfully
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7581d9e-3a66-417d-864d-e06d338f8816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:15 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Flow 'volume_create_manager' (28aa89b4-38fe-49e8-ab12-63fcc0752ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:15 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6027b9e0-a66e-4643-80bf-a735251444e9 tempest-VolumesTransfersTest-234096276 None] Created volume successfully.
Apr 20 18:45:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Acquiring lock "cinder-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Acquiring lock "cinder-quobyte-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-quobyte-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:16 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb0e9ec-ab4b-4229-91a0-b9aa01a2615c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:16 devstack sudo[89635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac
Apr 20 18:45:16 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:17 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:17 devstack sudo[89640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac
Apr 20 18:45:17 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:17 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac" returned: 0 in 0.412s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-quobyte-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac" released by "delete_volume" :: held 0.895s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Created reservations ['5e04b3f5-73fb-48b5-a127-ca6193afe3fe', '07e41cc3-056d-48b7-936c-24609de295a9', 'aab47dc0-76ef-41d0-8698-74897aa943df', '4fc1c317-a820-4e65-bee0-c09b395533ac'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:17 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:17 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:18 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.443s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:18 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:18 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Deleted volume successfully.
Apr 20 18:45:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a4097873-12ad-4b6a-b9d9-74f6bd5ac957 tempest-VolumesTransfersTest-737085962 None] Lock "cinder-6b73fc4f-ce04-4d2a-98a6-c59dbd9d5bac-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Flow 'volume_create_manager' (767aeb5b-f9f7-4cd2-ae1a-c1c6b8ad92ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25722a9d-5dde-4665-af2d-9253ddce54f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25722a9d-5dde-4665-af2d-9253ddce54f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1980889430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77994296-9fcf-49c4-a40c-7dc6ca9b1afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc3bc7313bf4b2a82585a4dba27c763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:21Z,use_quota=True,user_id='0f463f52e20547f4bd9862dd53e7dac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11e8a29-5b6d-45a4-a6b2-128e2fe05cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11e8a29-5b6d-45a4-a6b2-128e2fe05cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e6d77f-9516-4d36-a1df-08d1c650c36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e6d77f-9516-4d36-a1df-08d1c650c36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'volume_name': 'volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc08d4aa-62ee-4ee2-b9d5-7cb5d9e39db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc08d4aa-62ee-4ee2-b9d5-7cb5d9e39db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d4bf6e-4ab9-4321-8610-7488ef3dde31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:20 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Volume 77994296-9fcf-49c4-a40c-7dc6ca9b1afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'volume_size': 1}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1980889430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77994296-9fcf-49c4-a40c-7dc6ca9b1afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc3bc7313bf4b2a82585a4dba27c763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:21Z,use_quota=True,user_id='0f463f52e20547f4bd9862dd53e7dac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Creating volume 77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:45:20 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:45:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:20 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa 1073741824
Apr 20 18:45:20 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:21 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa 1073741824" returned: 0 in 0.472s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:21 devstack sudo[89688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:21 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:21 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.405s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d4bf6e-4ab9-4321-8610-7488ef3dde31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d31dae4-43b7-497f-91cc-3b21fd367d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:21 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Volume volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa (77994296-9fcf-49c4-a40c-7dc6ca9b1afa): created successfully
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d31dae4-43b7-497f-91cc-3b21fd367d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Flow 'volume_create_manager' (767aeb5b-f9f7-4cd2-ae1a-c1c6b8ad92ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3c558303-c577-496f-946d-1069f37bc3c4 tempest-VolumesCloneTest-1746819907 None] Created volume successfully.
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Flow 'volume_create_manager' (32309682-3a12-413d-b75f-c99d63fd658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e94b39-f150-49c4-b4a8-69f8755e6e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e94b39-f150-49c4-b4a8-69f8755e6e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2132992306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978bc7b8-64e0-4874-b803-64f85a5b0d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acc3bc7313bf4b2a82585a4dba27c763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=77994296-9fcf-49c4-a40c-7dc6ca9b1afa,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:23Z,use_quota=True,user_id='0f463f52e20547f4bd9862dd53e7dac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d5652a-57fb-4055-abd9-317de2a33eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d5652a-57fb-4055-abd9-317de2a33eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3fe447-e501-4c63-8554-11dffc245fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3fe447-e501-4c63-8554-11dffc245fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '978bc7b8-64e0-4874-b803-64f85a5b0d21', 'volume_name': 'volume-978bc7b8-64e0-4874-b803-64f85a5b0d21', 'volume_size': 2, 'source_volid': '77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab2526b-51ee-44f4-b59c-f1e07ea1f838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab2526b-51ee-44f4-b59c-f1e07ea1f838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e7ebc0-b194-4b63-8e7a-5e5c4f3727de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Volume 978bc7b8-64e0-4874-b803-64f85a5b0d21: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-978bc7b8-64e0-4874-b803-64f85a5b0d21', 'volume_size': 2, 'source_volid': '77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'source_volstatus': 'available'}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:23 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Cloning volume 77994296-9fcf-49c4-a40c-7dc6ca9b1afa to volume 978bc7b8-64e0-4874-b803-64f85a5b0d21
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Creating offline snapshot 94e89821-554b-4c46-9989-af58ed60b42f of volume 77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef719fb-2538-4244-8a68-8c2666942de3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:23 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:23 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:23 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:23 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f 1G
Apr 20 18:45:23 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:24 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f 1G" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:24 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f
Apr 20 18:45:24 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:24 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:24 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f is being set with open permissions: ugo+rw
Apr 20 18:45:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:24 devstack sudo[89706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f
Apr 20 18:45:24 devstack sudo[89706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:24 devstack sudo[89706]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f" returned: 0 in 0.395s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:25 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info
Apr 20 18:45:25 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:25 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info" returned: 0 in 0.414s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:25 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info is being set with open permissions: ugo+rw
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:25 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info
Apr 20 18:45:25 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:25 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.info" returned: 0 in 0.398s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "cinder-quobyte-978bc7b8-64e0-4874-b803-64f85a5b0d21" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-978bc7b8-64e0-4874-b803-64f85a5b0d21" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] snapshot: 94e89821-554b-4c46-9989-af58ed60b42f, volume: 978bc7b8-64e0-4874-b803-64f85a5b0d21,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c050622e-5ef8-4dd3-8c51-2d2ba4b5e79c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:25 devstack sudo[89715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f
Apr 20 18:45:25 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:26 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca36c6f-b93f-4e48-b7af-afa674adf323]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:26 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:26 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:26 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:45:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:26 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21
Apr 20 18:45:26 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:28 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21" returned: 0 in 1.946s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:28 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[72405eea-fc52-4c43-b1a7-ae658fc8f450]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:28 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:28 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:29 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.594s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:45:29 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Converted 1024.00 MB image at 525.90 MB/s
Apr 20 18:45:29 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 is being set with open permissions: ugo+rw
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:29 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21
Apr 20 18:45:29 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:29 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21" returned: 0 in 0.396s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-978bc7b8-64e0-4874-b803-64f85a5b0d21" released by "_copy_volume_from_snapshot" :: held 3.912s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "cinder-quobyte-94e89821-554b-4c46-9989-af58ed60b42f" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-94e89821-554b-4c46-9989-af58ed60b42f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Deleting offline snapshot 94e89821-554b-4c46-9989-af58ed60b42f of volume 77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] snapshot_file for this snap is: volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec22d5ca-8d63-4230-a7e3-b4803bf4645c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:29 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f
Apr 20 18:45:29 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:30 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f" returned: 0 in 0.459s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:30 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:45:30 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924bd46-45aa-476f-b084-ad8595998423]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:30 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:30 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:30 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:30 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f
Apr 20 18:45:30 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:31 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f" returned: 0 in 0.437s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:31 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f
Apr 20 18:45:31 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:31 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa.94e89821-554b-4c46-9989-af58ed60b42f" returned: 0 in 0.397s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-94e89821-554b-4c46-9989-af58ed60b42f" released by "_delete_snapshot" :: held 1.792s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.345s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e7ebc0-b194-4b63-8e7a-5e5c4f3727de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978bc7b8-64e0-4874-b803-64f85a5b0d21', 'volume_size': 2, 'source_volid': '77994296-9fcf-49c4-a40c-7dc6ca9b1afa', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac517a36-16a1-49bf-a214-09467a1882a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:31 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Volume volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 (978bc7b8-64e0-4874-b803-64f85a5b0d21): created successfully
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac517a36-16a1-49bf-a214-09467a1882a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Flow 'volume_create_manager' (32309682-3a12-413d-b75f-c99d63fd658a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:31 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5ff3218c-5aea-4165-a2f5-7a476a7716f5 tempest-VolumesCloneTest-1746819907 None] Created volume successfully.
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Acquiring lock "cinder-978bc7b8-64e0-4874-b803-64f85a5b0d21-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Lock "cinder-978bc7b8-64e0-4874-b803-64f85a5b0d21-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Acquiring lock "cinder-quobyte-978bc7b8-64e0-4874-b803-64f85a5b0d21" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-978bc7b8-64e0-4874-b803-64f85a5b0d21" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[825e504c-0025-4a0b-a855-b6333a3a8cb0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:31 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21
Apr 20 18:45:31 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:32 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21" returned: 0 in 0.452s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:32 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21
Apr 20 18:45:32 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:32 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-978bc7b8-64e0-4874-b803-64f85a5b0d21" returned: 0 in 0.400s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-978bc7b8-64e0-4874-b803-64f85a5b0d21" released by "delete_volume" :: held 0.884s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Created reservations ['35085052-497a-4e22-8904-5e241d3b4b90', 'cb1ae5cd-745d-43fb-8cd3-65c3d95df8d0', '7bfdb6d2-f2aa-4954-b656-887683aabc96', '26800566-7baf-41be-b105-a8874abd5f06'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:32 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:32 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "cinder-77994296-9fcf-49c4-a40c-7dc6ca9b1afa-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-77994296-9fcf-49c4-a40c-7dc6ca9b1afa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "cinder-quobyte-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40844c0-4188-49e7-8435-bff26bde0681]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:33 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:33 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:33 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.415s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:33 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Deleted volume successfully.
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8c0a8b10-b962-4911-9157-118751785edf tempest-VolumesCloneTest-1746819907 None] Lock "cinder-978bc7b8-64e0-4874-b803-64f85a5b0d21-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:33 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:33 devstack sudo[89780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa
Apr 20 18:45:33 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:33 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" returned: 0 in 0.400s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-quobyte-77994296-9fcf-49c4-a40c-7dc6ca9b1afa" released by "delete_volume" :: held 0.901s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Created reservations ['4cb2685b-ae01-4674-8f07-3ad6cc715297', 'de26aafd-2a67-4acd-919a-baa073ce8de3', '2ee21d57-8fd4-49a2-acc2-8429fad8b484', '8e4b6e7c-b6bb-4ded-b416-e40708f2b0d8'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:34 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:45:34 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:34 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:34 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:45:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Deleted volume successfully.
Apr 20 18:45:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-a0b39f77-f654-443f-b51d-a1fe1439b496 tempest-VolumesCloneTest-1746819907 None] Lock "cinder-77994296-9fcf-49c4-a40c-7dc6ca9b1afa-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Flow 'volume_create_manager' (47d28cab-0428-483a-bd9a-bd02ebf635ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6949dda9-aed3-4a69-8b23-522baacc81dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6949dda9-aed3-4a69-8b23-522baacc81dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1771013107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e299dae-d400-4ac4-a031-55a6b65f89f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995ae4a76e54dc28101358eea864426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:36Z,use_quota=True,user_id='1341dc99e2394d0f8b3798e0ccada331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e500c7a6-04c4-4047-b1ac-6a23778cb997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e500c7a6-04c4-4047-b1ac-6a23778cb997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21978dea-1ca9-4484-9eb3-b5a67b05fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21978dea-1ca9-4484-9eb3-b5a67b05fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e299dae-d400-4ac4-a031-55a6b65f89f4', 'volume_name': 'volume-3e299dae-d400-4ac4-a031-55a6b65f89f4', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49177c8-28af-4272-9edd-5cdceb2a983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49177c8-28af-4272-9edd-5cdceb2a983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950ec091-759c-4bda-a414-e198535fbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:35 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Volume 3e299dae-d400-4ac4-a031-55a6b65f89f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e299dae-d400-4ac4-a031-55a6b65f89f4', 'volume_size': 1}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1771013107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e299dae-d400-4ac4-a031-55a6b65f89f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e995ae4a76e54dc28101358eea864426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:45:36Z,use_quota=True,user_id='1341dc99e2394d0f8b3798e0ccada331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Creating volume 3e299dae-d400-4ac4-a031-55a6b65f89f4 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:45:35 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:45:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:35 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 1073741824
Apr 20 18:45:35 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:36 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 1073741824" returned: 0 in 0.472s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:45:36 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4
Apr 20 18:45:36 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:45:36 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4" returned: 0 in 0.397s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950ec091-759c-4bda-a414-e198535fbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e299dae-d400-4ac4-a031-55a6b65f89f4', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f8ec82-42b9-4185-ae0a-3b687aa92eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:45:36 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Volume volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 (3e299dae-d400-4ac4-a031-55a6b65f89f4): created successfully
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f8ec82-42b9-4185-ae0a-3b687aa92eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:45:36 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Flow 'volume_create_manager' (47d28cab-0428-483a-bd9a-bd02ebf635ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:45:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7e72cce4-2c0b-4204-a107-1f0aef71bffa tempest-VolumesNegativeTest-754855372 None] Created volume successfully.
Apr 20 18:45:46 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:INSERT=24,cinder:UPDATE=104,cinder:SELECT=56,cinder:DELETE=10 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:45:46 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:DELETE=7,cinder:SELECT=69,cinder:INSERT=24,cinder:UPDATE=93 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Acquiring lock "cinder-3e299dae-d400-4ac4-a031-55a6b65f89f4-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Lock "cinder-3e299dae-d400-4ac4-a031-55a6b65f89f4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Acquiring lock "cinder-quobyte-3e299dae-d400-4ac4-a031-55a6b65f89f4" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Lock "cinder-quobyte-3e299dae-d400-4ac4-a031-55a6b65f89f4" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e3d92a-f444-44dd-9f9d-5081ebbce5cc]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:00 devstack sudo[89878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4
Apr 20 18:46:00 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:00 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4" returned: 0 in 0.461s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:01 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4
Apr 20 18:46:01 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:01 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3e299dae-d400-4ac4-a031-55a6b65f89f4" returned: 0 in 0.395s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Lock "cinder-quobyte-3e299dae-d400-4ac4-a031-55a6b65f89f4" released by "delete_volume" :: held 0.887s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Created reservations ['5ff151a7-669b-434e-9d37-b64c3576be1d', '2a65bed5-33e3-4093-84e3-3ac7137915cc', '2812c960-9e52-4f4b-b69b-27673ef73705', 'fd086b26-a141-4b12-830a-7a96fb41b8e5'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:01 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:01 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:01 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Deleted volume successfully.
Apr 20 18:46:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-0e8da778-c4dd-4250-b610-718d597393e6 tempest-VolumesNegativeTest-754855372 None] Lock "cinder-3e299dae-d400-4ac4-a031-55a6b65f89f4-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:02 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:02 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:02 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Flow 'volume_create_manager' (53886685-a033-4033-9d7f-d0300d718771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611f3796-1a3c-4fe9-9861-48c32c40c856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611f3796-1a3c-4fe9-9861-48c32c40c856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495a2227-7d0f-45c1-9a3a-f70eb34dcd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a9174a59e640618dedd061babbe179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:03Z,use_quota=True,user_id='3631e1c9012e41729e33cfd5ae53709c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c18127-cab1-4493-89a1-7c0a51913fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c18127-cab1-4493-89a1-7c0a51913fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de03ecab-c07a-44c8-a36a-a262b3b2a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de03ecab-c07a-44c8-a36a-a262b3b2a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495a2227-7d0f-45c1-9a3a-f70eb34dcd3d', 'volume_name': 'volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bbf05d-897d-44b0-80ee-3d68f637dfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bbf05d-897d-44b0-80ee-3d68f637dfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6611ab3-b437-4b29-b2a8-8c460cd28c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:02 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Volume 495a2227-7d0f-45c1-9a3a-f70eb34dcd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d', 'volume_size': 1}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495a2227-7d0f-45c1-9a3a-f70eb34dcd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a9174a59e640618dedd061babbe179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:03Z,use_quota=True,user_id='3631e1c9012e41729e33cfd5ae53709c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Creating volume 495a2227-7d0f-45c1-9a3a-f70eb34dcd3d {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:02 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:02 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d 1073741824
Apr 20 18:46:03 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:03 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d 1073741824" returned: 0 in 0.464s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:03 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d
Apr 20 18:46:03 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:03 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d" returned: 0 in 0.403s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6611ab3-b437-4b29-b2a8-8c460cd28c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3751fe9f-bc60-4599-85f5-52a6c206d868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:03 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Volume volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d (495a2227-7d0f-45c1-9a3a-f70eb34dcd3d): created successfully
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3751fe9f-bc60-4599-85f5-52a6c206d868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:03 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Flow 'volume_create_manager' (53886685-a033-4033-9d7f-d0300d718771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:03 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0f4c0179-de00-43f7-80ac-9a6c12ec9424 tempest-CinderUnicodeTest-779358282 None] Created volume successfully.
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Flow 'volume_create_manager' (4097cce0-4f83-4b38-b6f4-73072913e2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdb6d82-dc78-4ced-87e4-efe236e28a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdb6d82-dc78-4ced-87e4-efe236e28a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1948634472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3239324b-60f7-4468-a2a6-13c996899f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a9174a59e640618dedd061babbe179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:05Z,use_quota=True,user_id='3631e1c9012e41729e33cfd5ae53709c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512646ed-4f29-4595-acec-4de75629914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512646ed-4f29-4595-acec-4de75629914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9eccf2-1969-488c-b4a5-93fc3afd7ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9eccf2-1969-488c-b4a5-93fc3afd7ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3239324b-60f7-4468-a2a6-13c996899f73', 'volume_name': 'volume-3239324b-60f7-4468-a2a6-13c996899f73', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b0da45-e059-444f-a467-7707b1eb14a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b0da45-e059-444f-a467-7707b1eb14a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d9abdb-7935-4388-98ea-53e5bcb507ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:05 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Volume 3239324b-60f7-4468-a2a6-13c996899f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3239324b-60f7-4468-a2a6-13c996899f73', 'volume_size': 1}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1948634472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3239324b-60f7-4468-a2a6-13c996899f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57a9174a59e640618dedd061babbe179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:05Z,use_quota=True,user_id='3631e1c9012e41729e33cfd5ae53709c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Creating volume 3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:05 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:05 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 1073741824
Apr 20 18:46:05 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:05 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 1073741824" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:05 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73
Apr 20 18:46:05 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:06 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73" returned: 0 in 0.420s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d9abdb-7935-4388-98ea-53e5bcb507ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3239324b-60f7-4468-a2a6-13c996899f73', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b9e41d-5c34-4f1c-8d91-4e46680993bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:06 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Volume volume-3239324b-60f7-4468-a2a6-13c996899f73 (3239324b-60f7-4468-a2a6-13c996899f73): created successfully
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b9e41d-5c34-4f1c-8d91-4e46680993bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:06 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Flow 'volume_create_manager' (4097cce0-4f83-4b38-b6f4-73072913e2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cb288e9e-6eaf-471b-a151-a7dfd35d3ba3 tempest-CinderUnicodeTest-779358282 None] Created volume successfully.
Apr 20 18:46:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:07 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Creating offline snapshot 1409b9a3-ee15-469f-b4ac-17f7467964ff of volume 3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:46:07 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc96226b-3302-497a-b872-5610eb9c8d54]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:07 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73
Apr 20 18:46:07 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:08 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:08 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff 1G
Apr 20 18:46:08 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:08 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff 1G" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3239324b-60f7-4468-a2a6-13c996899f73 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:08 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3239324b-60f7-4468-a2a6-13c996899f73 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff
Apr 20 18:46:08 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:08 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3239324b-60f7-4468-a2a6-13c996899f73 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff" returned: 0 in 0.419s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:08 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff is being set with open permissions: ugo+rw
Apr 20 18:46:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:08 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff
Apr 20 18:46:08 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:09 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:09 devstack sudo[89934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info
Apr 20 18:46:09 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:09 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info" returned: 0 in 0.406s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:09 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info is being set with open permissions: ugo+rw
Apr 20 18:46:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:09 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info
Apr 20 18:46:09 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:10 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.info" returned: 0 in 0.394s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:10 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7d95fc7d-80cf-46c3-a7e5-8d05c7163f94 tempest-CinderUnicodeTest-779358282 None] Create snapshot completed successfully
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-1409b9a3-ee15-469f-b4ac-17f7467964ff-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-1409b9a3-ee15-469f-b4ac-17f7467964ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-quobyte-3239324b-60f7-4468-a2a6-13c996899f73" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-3239324b-60f7-4468-a2a6-13c996899f73" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-quobyte-1409b9a3-ee15-469f-b4ac-17f7467964ff" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-1409b9a3-ee15-469f-b4ac-17f7467964ff" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Deleting offline snapshot 1409b9a3-ee15-469f-b4ac-17f7467964ff of volume 3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] snapshot_file for this snap is: volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0214da2-4993-4180-99aa-af9d869d3708]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:10 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff
Apr 20 18:46:10 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:11 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:11 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3239324b-60f7-4468-a2a6-13c996899f73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:46:11 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05a956e-81bc-4621-8dfc-bf658079b24a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:11 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73
Apr 20 18:46:11 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:11 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:11 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff
Apr 20 18:46:11 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:12 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:12 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff
Apr 20 18:46:12 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:12 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73.1409b9a3-ee15-469f-b4ac-17f7467964ff" returned: 0 in 0.405s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-1409b9a3-ee15-469f-b4ac-17f7467964ff" released by "_delete_snapshot" :: held 1.835s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-3239324b-60f7-4468-a2a6-13c996899f73" released by "delete_snapshot" :: held 1.847s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Created reservations ['6898991c-755b-4363-ae04-fca48701bb0e', '4808e9e8-36bb-44c8-bd95-edc6d0aa5178', 'c30162ff-4e04-4ba9-b4fb-ec627cb8343a', '3551a581-d76b-46c3-8052-cf49667f0637'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:12 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Delete snapshot completed successfully.
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-2c52ff19-018e-4f03-9add-5a7e6808fb53 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-1409b9a3-ee15-469f-b4ac-17f7467964ff-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-3239324b-60f7-4468-a2a6-13c996899f73-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-3239324b-60f7-4468-a2a6-13c996899f73-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-quobyte-3239324b-60f7-4468-a2a6-13c996899f73" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-3239324b-60f7-4468-a2a6-13c996899f73" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd5482-8802-43f6-902c-ab11c46d28b8]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:12 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73
Apr 20 18:46:12 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:13 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:13 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73
Apr 20 18:46:13 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:13 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3239324b-60f7-4468-a2a6-13c996899f73" returned: 0 in 0.400s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-3239324b-60f7-4468-a2a6-13c996899f73" released by "delete_volume" :: held 0.892s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Created reservations ['8102a5f3-9c8e-42ef-8f03-71b7a2c1b328', '3bba41df-7be7-46a7-8671-7ec4af5efc84', 'a2f63e88-df1a-4474-b7d2-d2478ce4eb86', '4084db0d-53a2-480e-8d9f-7f64e66f79f2'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:13 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:13 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Lock "cinder-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Acquiring lock "cinder-quobyte-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0fd82-d75b-4307-a777-450262e1ead5]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:14 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d
Apr 20 18:46:14 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:14 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Deleted volume successfully.
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-eec012a7-04c6-425a-b9a2-9ecbda649201 tempest-CinderUnicodeTest-779358282 None] Lock "cinder-3239324b-60f7-4468-a2a6-13c996899f73-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:14 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d" returned: 0 in 0.477s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:14 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d
Apr 20 18:46:14 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:14 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d" returned: 0 in 0.403s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Lock "cinder-quobyte-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d" released by "delete_volume" :: held 0.906s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Created reservations ['3d7e3ba4-0715-4dd8-86ab-cc0914af2de4', 'c202c7af-f820-412e-a119-4d8c0f0d09b6', '4d6d5674-9d78-4008-8f99-77c2c8fb26b4', 'b4433c58-fb5e-4a71-b0a2-8629e5060873'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:14 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:14 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:15 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.430s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:15 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:15 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Deleted volume successfully.
Apr 20 18:46:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-987e3b68-4b3d-4c3d-bbf6-fd9e1aac774a tempest-CinderUnicodeTest-779358282 None] Lock "cinder-495a2227-7d0f-45c1-9a3a-f70eb34dcd3d-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (84dc2997-37dc-4663-b61f-d5c1462c1e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82041b1d-9083-48d9-8de1-71030e94bb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82041b1d-9083-48d9-8de1-71030e94bb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-911449933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93886080-f9f4-4859-83ff-63252cf967e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66541c5f-8fdf-4f7f-8867-e8918606f024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66541c5f-8fdf-4f7f-8867-e8918606f024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a5bd1c-7359-4550-8907-169e6a29fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a5bd1c-7359-4550-8907-169e6a29fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93886080-f9f4-4859-83ff-63252cf967e0', 'volume_name': 'volume-93886080-f9f4-4859-83ff-63252cf967e0', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296c076f-a75d-4bfd-8953-cf43020a16c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296c076f-a75d-4bfd-8953-cf43020a16c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607723bd-6bba-4ce1-86c7-9afa0b6e9f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:21 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Volume 93886080-f9f4-4859-83ff-63252cf967e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93886080-f9f4-4859-83ff-63252cf967e0', 'volume_size': 1}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-911449933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93886080-f9f4-4859-83ff-63252cf967e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Creating volume 93886080-f9f4-4859-83ff-63252cf967e0 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:21 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:22 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0 1073741824
Apr 20 18:46:22 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (9a04c2a2-a4bc-4869-b0c4-4f90d2228864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935ce354-2a48-4188-8dc7-ddfa38801f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (935ce354-2a48-4188-8dc7-ddfa38801f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870737230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5cc748-78e7-4ca0-a5dc-587286293530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0ad869-7bbe-4444-9bbd-e4c26b46020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0ad869-7bbe-4444-9bbd-e4c26b46020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5505c9-c3cc-401c-a458-a17c34db1ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5505c9-c3cc-401c-a458-a17c34db1ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5cc748-78e7-4ca0-a5dc-587286293530', 'volume_name': 'volume-0d5cc748-78e7-4ca0-a5dc-587286293530', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066ddedf-adaa-4d49-a2fb-0fad701769d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066ddedf-adaa-4d49-a2fb-0fad701769d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a42f78-86e9-4eaf-b290-7da1cddc8a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume 0d5cc748-78e7-4ca0-a5dc-587286293530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5cc748-78e7-4ca0-a5dc-587286293530', 'volume_size': 1}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (140cab2d-273c-4f4c-8b57-59947132bd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee6fc39-bf7f-4f2f-a10c-827bb48f6dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee6fc39-bf7f-4f2f-a10c-827bb48f6dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-60772449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1783a133-ba0b-412e-bf20-0f11dfffa3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b95d71b-f9eb-4073-95d4-215d88aeb17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b95d71b-f9eb-4073-95d4-215d88aeb17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d1e267-79e3-4911-914f-875bec37a3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d1e267-79e3-4911-914f-875bec37a3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1783a133-ba0b-412e-bf20-0f11dfffa3a2', 'volume_name': 'volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba00c205-2841-4c6a-83b3-86f74f085db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba00c205-2841-4c6a-83b3-86f74f085db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49af9f6-ebca-4c97-9286-a41a97c3c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Volume 1783a133-ba0b-412e-bf20-0f11dfffa3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2', 'volume_size': 1}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (e946e491-8492-4a85-bce0-2749230d47b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75abd74d-f1ad-4599-b14d-437a579c17c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75abd74d-f1ad-4599-b14d-437a579c17c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1668068361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f89d34-a748-458c-b6bf-254560e171d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0729df23a84afba8338dc6c8a1ee8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='8d019ec988824acbae7413a253333735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f9b9bc-5fd5-4097-8966-26524ac67af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f9b9bc-5fd5-4097-8966-26524ac67af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43db00a4-af48-4565-bbae-358d444d06a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43db00a4-af48-4565-bbae-358d444d06a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f89d34-a748-458c-b6bf-254560e171d4', 'volume_name': 'volume-63f89d34-a748-458c-b6bf-254560e171d4', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1d344d-bd30-4399-a00f-1b76931c488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1d344d-bd30-4399-a00f-1b76931c488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff610755-dcb4-4897-a64b-aec08ad99032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Volume 63f89d34-a748-458c-b6bf-254560e171d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f89d34-a748-458c-b6bf-254560e171d4', 'volume_size': 1}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (2d95615d-ccd5-4766-ae8e-abad8fe6c685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be04215-a6a5-4034-a291-6a08820fa1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be04215-a6a5-4034-a291-6a08820fa1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819859794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0169469-0aa0-4ae0-8a0e-a3518056ed89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c646c8-0c6e-4c4c-b073-bbbc10e59749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c646c8-0c6e-4c4c-b073-bbbc10e59749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b1816e-a193-4dca-a6e3-51e6a65a9022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b1816e-a193-4dca-a6e3-51e6a65a9022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0169469-0aa0-4ae0-8a0e-a3518056ed89', 'volume_name': 'volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7c80f9-fa12-45f0-ba6e-2a7d3f5dfd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7c80f9-fa12-45f0-ba6e-2a7d3f5dfd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96902940-3cc0-4c86-99ca-4bb24f8bb2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Volume b0169469-0aa0-4ae0-8a0e-a3518056ed89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89', 'volume_size': 1}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:22 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0 1073741824" returned: 0 in 0.670s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:22 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0
Apr 20 18:46:22 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (687a0c75-0924-4fdd-b7d3-25b6f6e820ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee91bc9-21f5-4233-8cc7-8698420a1fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee91bc9-21f5-4233-8cc7-8698420a1fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853775758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1dfa61-0576-4453-a973-a6746ba7a5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:23Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477b92ad-82eb-45b5-9b2f-7acea13c5e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477b92ad-82eb-45b5-9b2f-7acea13c5e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497ac030-e306-495d-8865-3a67bd9b1330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497ac030-e306-495d-8865-3a67bd9b1330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1dfa61-0576-4453-a973-a6746ba7a5e6', 'volume_name': 'volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81818484-7856-4b6c-b9f5-0d2d8c4318fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81818484-7856-4b6c-b9f5-0d2d8c4318fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58080ff-8bd7-46d8-8d79-cf04bffb861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:22 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Volume 3d1dfa61-0576-4453-a973-a6746ba7a5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6', 'volume_size': 1}
Apr 20 18:46:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (bbfb4e57-a479-449b-bcb5-837c67d4b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b824cb4-a569-492f-9e53-ad60b5cf2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b824cb4-a569-492f-9e53-ad60b5cf2395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675022572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bc3533-9c72-402f-a4c9-ead03e74a036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:23Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6f0a89-3bbf-46cf-980e-7420f335a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6f0a89-3bbf-46cf-980e-7420f335a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd9d48-9abf-495b-b188-186dc2c6f7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccd9d48-9abf-495b-b188-186dc2c6f7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35bc3533-9c72-402f-a4c9-ead03e74a036', 'volume_name': 'volume-35bc3533-9c72-402f-a4c9-ead03e74a036', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f876590-6fb4-4e2d-af9d-05bdaa47fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f876590-6fb4-4e2d-af9d-05bdaa47fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0039a35-4016-4017-851f-d681872b77b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Volume 35bc3533-9c72-402f-a4c9-ead03e74a036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35bc3533-9c72-402f-a4c9-ead03e74a036', 'volume_size': 1}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:23 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0" returned: 0 in 0.450s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1870737230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5cc748-78e7-4ca0-a5dc-587286293530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating volume 0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:23 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607723bd-6bba-4ce1-86c7-9afa0b6e9f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93886080-f9f4-4859-83ff-63252cf967e0', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ecb737-18f1-493c-804d-074d319fafe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:23 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 1073741824
Apr 20 18:46:23 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:23 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Volume volume-93886080-f9f4-4859-83ff-63252cf967e0 (93886080-f9f4-4859-83ff-63252cf967e0): created successfully
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ecb737-18f1-493c-804d-074d319fafe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (84dc2997-37dc-4663-b61f-d5c1462c1e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:23 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c637b41c-c934-4113-a865-73d507cbe869 tempest-CreateVolumesFromImageTest-1382145497 None] Created volume successfully.
Apr 20 18:46:23 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 1073741824" returned: 0 in 0.544s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:23 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:23 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530
Apr 20 18:46:23 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:24 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-60772449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1783a133-ba0b-412e-bf20-0f11dfffa3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Creating volume 1783a133-ba0b-412e-bf20-0f11dfffa3a2 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:24 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a42f78-86e9-4eaf-b290-7da1cddc8a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5cc748-78e7-4ca0-a5dc-587286293530', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5ffcc3-cb21-4759-891a-96a8c9f6b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:24 devstack sudo[90075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 1073741824
Apr 20 18:46:24 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:24 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume volume-0d5cc748-78e7-4ca0-a5dc-587286293530 (0d5cc748-78e7-4ca0-a5dc-587286293530): created successfully
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5ffcc3-cb21-4759-891a-96a8c9f6b648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (9a04c2a2-a4bc-4869-b0c4-4f90d2228864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:24 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e0e3ce50-3cc1-47f2-b14d-45f266564dfe tempest-CreateVolumesFromSnapshotTest-793516669 None] Created volume successfully.
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:24 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 1073741824" returned: 0 in 0.554s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:24 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:24 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2
Apr 20 18:46:24 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:25 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1668068361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f89d34-a748-458c-b6bf-254560e171d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0729df23a84afba8338dc6c8a1ee8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='8d019ec988824acbae7413a253333735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Creating volume 63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:25 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49af9f6-ebca-4c97-9286-a41a97c3c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11292f1-7ab9-4c44-8955-8008830ea8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:25 devstack sudo[90083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 1073741824
Apr 20 18:46:25 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:25 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Volume volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 (1783a133-ba0b-412e-bf20-0f11dfffa3a2): created successfully
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11292f1-7ab9-4c44-8955-8008830ea8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (140cab2d-273c-4f4c-8b57-59947132bd5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:25 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-dc989d1f-69da-4f00-96c3-7690dc31a9a0 tempest-CreateVolumesFromImageTest-1382145497 None] Created volume successfully.
Apr 20 18:46:25 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 1073741824" returned: 0 in 0.505s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:25 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:25 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:25 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:26 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-819859794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0169469-0aa0-4ae0-8a0e-a3518056ed89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:22Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Creating volume b0169469-0aa0-4ae0-8a0e-a3518056ed89 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:26 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff610755-dcb4-4897-a64b-aec08ad99032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f89d34-a748-458c-b6bf-254560e171d4', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cb10f1-7ed2-41bf-b4fd-d2a179b1da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:26 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 1073741824
Apr 20 18:46:26 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:26 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Volume volume-63f89d34-a748-458c-b6bf-254560e171d4 (63f89d34-a748-458c-b6bf-254560e171d4): created successfully
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cb10f1-7ed2-41bf-b4fd-d2a179b1da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (e946e491-8492-4a85-bce0-2749230d47b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:26 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-417073c6-c714-41a6-a0e8-b875cb51f1b9 tempest-VolumeDependencyTests-1447693068 None] Created volume successfully.
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:26 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 1073741824" returned: 0 in 0.571s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:26 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:26 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89
Apr 20 18:46:26 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:27 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89" returned: 0 in 0.477s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.485s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853775758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1dfa61-0576-4453-a973-a6746ba7a5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:23Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Creating volume 3d1dfa61-0576-4453-a973-a6746ba7a5e6 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:27 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:27 devstack sudo[90099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 1073741824
Apr 20 18:46:27 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96902940-3cc0-4c86-99ca-4bb24f8bb2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac1df35-cc84-496d-9e80-c3907390dc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:27 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Volume volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 (b0169469-0aa0-4ae0-8a0e-a3518056ed89): created successfully
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac1df35-cc84-496d-9e80-c3907390dc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (2d95615d-ccd5-4766-ae8e-abad8fe6c685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:27 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-81750da0-0226-4065-a5c9-e95e6d05d00d tempest-CreateVolumesFromImageTest-1382145497 None] Created volume successfully.
Apr 20 18:46:27 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 1073741824" returned: 0 in 0.573s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:27 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:27 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6
Apr 20 18:46:27 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:28 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.326s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-675022572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35bc3533-9c72-402f-a4c9-ead03e74a036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0193fae50848bb9b3b925f501eedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:23Z,use_quota=True,user_id='23468a8cebe74eaba256907760c5a991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Creating volume 35bc3533-9c72-402f-a4c9-ead03e74a036 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:28 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58080ff-8bd7-46d8-8d79-cf04bffb861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebc5329-ba95-4fb7-88fc-64924e884e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:28 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036 1073741824
Apr 20 18:46:28 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:28 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Volume volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 (3d1dfa61-0576-4453-a973-a6746ba7a5e6): created successfully
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebc5329-ba95-4fb7-88fc-64924e884e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (687a0c75-0924-4fdd-b7d3-25b6f6e820ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:28 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-0a949790-3482-4d6e-bd5c-d41c4b32afac tempest-CreateVolumesFromImageTest-1382145497 None] Created volume successfully.
Apr 20 18:46:28 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036 1073741824" returned: 0 in 0.519s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:28 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:28 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036
Apr 20 18:46:28 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:29 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036" returned: 0 in 0.458s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.883s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0039a35-4016-4017-851f-d681872b77b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35bc3533-9c72-402f-a4c9-ead03e74a036', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e878de2d-fc6b-436c-bf2e-6a14c0bb0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating offline snapshot faac07fc-7f5f-4c82-9f05-f64539b7e0c2 of volume 0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:46:29 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Volume volume-35bc3533-9c72-402f-a4c9-ead03e74a036 (35bc3533-9c72-402f-a4c9-ead03e74a036): created successfully
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e878de2d-fc6b-436c-bf2e-6a14c0bb0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Flow 'volume_create_manager' (bbfb4e57-a479-449b-bcb5-837c67d4b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[481d0389-1e30-491e-9286-39bcfa5907f9]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:29 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:29 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-a35d10c7-69ec-460a-8d12-36e6be980147 tempest-CreateVolumesFromImageTest-1382145497 None] Created volume successfully.
Apr 20 18:46:29 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530
Apr 20 18:46:29 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:30 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530" returned: 0 in 0.528s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:30 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 1G
Apr 20 18:46:30 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:30 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 1G" returned: 0 in 0.511s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5cc748-78e7-4ca0-a5dc-587286293530 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:30 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5cc748-78e7-4ca0-a5dc-587286293530 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2
Apr 20 18:46:30 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-35bc3533-9c72-402f-a4c9-ead03e74a036-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-35bc3533-9c72-402f-a4c9-ead03e74a036-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-quobyte-35bc3533-9c72-402f-a4c9-ead03e74a036" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-35bc3533-9c72-402f-a4c9-ead03e74a036" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb7663-14ed-4d99-9621-db9eb724df12]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:30 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036
Apr 20 18:46:30 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:30 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5cc748-78e7-4ca0-a5dc-587286293530 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2" returned: 0 in 0.450s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:30 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 is being set with open permissions: ugo+rw
Apr 20 18:46:30 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:31 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2
Apr 20 18:46:31 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:31 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036" returned: 0 in 0.590s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:31 devstack sudo[90138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036
Apr 20 18:46:31 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:31 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:31 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info
Apr 20 18:46:31 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:31 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-35bc3533-9c72-402f-a4c9-ead03e74a036" returned: 0 in 0.477s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-35bc3533-9c72-402f-a4c9-ead03e74a036" released by "delete_volume" :: held 1.097s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Created reservations ['9290dd5e-1976-4359-8b71-661b761c4544', 'ecda6e4e-88bc-48c9-b588-92bfc652cae3', '85a35c99-c1c6-49c9-a267-4b37083a3ef9', '0df51acc-8695-4520-8fdd-5e24f9f982db'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:31 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:31 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:31 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:32 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info" returned: 0 in 0.540s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:32 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info is being set with open permissions: ugo+rw
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:32 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info
Apr 20 18:46:32 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:32 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.459s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Deleted volume successfully.
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-d0bad5ee-4e94-4900-9305-fdba75df840e tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-35bc3533-9c72-402f-a4c9-ead03e74a036-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:32 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.info" returned: 0 in 0.541s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.022s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Creating offline snapshot 98111428-e047-4c86-8adc-d7b0e4969b03 of volume 63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:46:32 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-bec8a9a7-d0a3-490f-a791-8b843a9e31bd tempest-CreateVolumesFromSnapshotTest-793516669 None] Create snapshot completed successfully
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e174be35-222d-492a-88bb-bafb79ac6c4d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:32 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:32 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-3d1dfa61-0576-4453-a973-a6746ba7a5e6-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-3d1dfa61-0576-4453-a973-a6746ba7a5e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-quobyte-3d1dfa61-0576-4453-a973-a6746ba7a5e6" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-3d1dfa61-0576-4453-a973-a6746ba7a5e6" acquired by "delete_volume" :: waited 0.028s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e682b-a59e-4bc7-afe1-817ae96e7845]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:32 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:33 devstack sudo[90153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6
Apr 20 18:46:33 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:33 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (d6d600a2-abd7-42b5-b6fa-e181d5b12e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356ac100-4785-43e6-b8ff-c29a5b848053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.638s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356ac100-4785-43e6-b8ff-c29a5b848053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185681085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:33Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3598067a-7663-4511-9708-9092f7a49e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3598067a-7663-4511-9708-9092f7a49e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ba4969-23e8-474f-93e7-0c687efb62c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ba4969-23e8-474f-93e7-0c687efb62c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86', 'volume_name': 'volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 1G
Apr 20 18:46:33 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbaeb6e0-21ab-420f-a3b3-d0ab6e714b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbaeb6e0-21ab-420f-a3b3-d0ab6e714b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0faeb5d-1d52-45c0-bf61-32501e2f2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86', 'volume_size': 1}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (fe81be5f-fff1-4eac-914b-44fdda043390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbef600-9c77-4899-ae15-49a7c78b75d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbef600-9c77-4899-ae15-49a7c78b75d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675225940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f32b8b-1363-4541-9712-6728d2878602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:33Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7b9914-2856-4b9a-b25e-27d7c4e68d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7b9914-2856-4b9a-b25e-27d7c4e68d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590aad42-f577-4b81-b5e1-6f24c57d8a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590aad42-f577-4b81-b5e1-6f24c57d8a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f32b8b-1363-4541-9712-6728d2878602', 'volume_name': 'volume-b8f32b8b-1363-4541-9712-6728d2878602', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07702439-16ed-4ad4-90c9-52166a7586f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07702439-16ed-4ad4-90c9-52166a7586f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972e5410-a405-41ea-a8e8-e549b4cae52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume b8f32b8b-1363-4541-9712-6728d2878602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f32b8b-1363-4541-9712-6728d2878602', 'volume_size': 1}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:33 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6" returned: 0 in 0.754s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:33 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6
Apr 20 18:46:33 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (a00c5743-f1dd-425c-95e8-cd20f0b764c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308c385e-f554-4a4e-81e5-92dc8cbcb1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308c385e-f554-4a4e-81e5-92dc8cbcb1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562520571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9abfb2-8449-4202-8be2-90302d3dd019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:34Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a440cc80-210d-457f-ae07-8ec8f2bd9061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a440cc80-210d-457f-ae07-8ec8f2bd9061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef806242-fb21-42b1-8ab5-395b9dea3bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef806242-fb21-42b1-8ab5-395b9dea3bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9abfb2-8449-4202-8be2-90302d3dd019', 'volume_name': 'volume-2d9abfb2-8449-4202-8be2-90302d3dd019', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c83c5d-a761-411d-b662-3ab373324995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c83c5d-a761-411d-b662-3ab373324995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4792827a-5d42-4a81-9c10-ea0d56d69b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:33 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume 2d9abfb2-8449-4202-8be2-90302d3dd019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9abfb2-8449-4202-8be2-90302d3dd019', 'volume_size': 1}
Apr 20 18:46:33 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:34 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 1G" returned: 0 in 0.843s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f89d34-a748-458c-b6bf-254560e171d4 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:34 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:34 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f89d34-a748-458c-b6bf-254560e171d4 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (65af4277-2eed-4567-8550-5d99e216cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:34 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a717a0a6-7fea-440c-b747-b0b69bd57d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-3d1dfa61-0576-4453-a973-a6746ba7a5e6" returned: 0 in 0.571s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a717a0a6-7fea-440c-b747-b0b69bd57d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1558627730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c03019-7ae0-4e3e-9353-90d5e7d9de60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:34Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aaf6c1-ae96-4f63-a81b-419b76f7c05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aaf6c1-ae96-4f63-a81b-419b76f7c05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ca9448-0ba6-4043-9768-f4b94a022f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ca9448-0ba6-4043-9768-f4b94a022f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c03019-7ae0-4e3e-9353-90d5e7d9de60', 'volume_name': 'volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47b8e46-772d-47f1-935d-e9f89f6ea1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47b8e46-772d-47f1-935d-e9f89f6ea1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c30969-d687-4a98-92e3-e991ab1764ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume 43c03019-7ae0-4e3e-9353-90d5e7d9de60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60', 'volume_size': 1}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-3d1dfa61-0576-4453-a973-a6746ba7a5e6" released by "delete_volume" :: held 1.396s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Created reservations ['7af5deb2-b22e-43a5-890f-377bdb14a21d', 'cd71675c-302b-4db3-9b4f-a4a688b4cfc1', 'fd548783-3b20-47fe-b7bd-1fb305b1debd', 'c2fa9b75-6118-49e5-9457-3f92c9891a5a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:34 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:34 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (f858cdea-289c-461a-9f65-826f1254b709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ccdba-c699-4113-917b-8dfc0b7d7bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ccdba-c699-4113-917b-8dfc0b7d7bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1801342083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e414bd-7939-426d-af53-562b0bfe4fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:34Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10cd5cd0-8829-49ea-89c6-e35fd0047986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10cd5cd0-8829-49ea-89c6-e35fd0047986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5efdda-6837-4f02-892f-ef4a35bec412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5efdda-6837-4f02-892f-ef4a35bec412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95e414bd-7939-426d-af53-562b0bfe4fed', 'volume_name': 'volume-95e414bd-7939-426d-af53-562b0bfe4fed', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d5ee8-ee88-46d3-8131-b56634847a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d5ee8-ee88-46d3-8131-b56634847a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22857795-2d90-4349-ad69-d3895422ab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume 95e414bd-7939-426d-af53-562b0bfe4fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95e414bd-7939-426d-af53-562b0bfe4fed', 'volume_size': 1}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Flow 'volume_create_manager' (cfaf0b9a-81f5-4508-b1ce-8836c86fc281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5845cef-4389-41d9-9ad0-69f28f190e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5845cef-4389-41d9-9ad0-69f28f190e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1618910173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20149ac4-78e9-4b73-b580-4264ac9c67ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691e0a782aa64945bd9e80f13bf99ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:35Z,use_quota=True,user_id='8c462681116c4b7a9ba52683c449681f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af35dee3-9573-4f60-bf5a-be97eccf03df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af35dee3-9573-4f60-bf5a-be97eccf03df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae84d059-56e7-4620-a1d7-c88592c3edb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae84d059-56e7-4620-a1d7-c88592c3edb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20149ac4-78e9-4b73-b580-4264ac9c67ba', 'volume_name': 'volume-20149ac4-78e9-4b73-b580-4264ac9c67ba', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4145e913-82f8-4970-b2f3-5d2f84d0b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4145e913-82f8-4970-b2f3-5d2f84d0b218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:34 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e54f73b-2d8e-4668-92a3-342c2a1a35fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:34 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Volume 20149ac4-78e9-4b73-b580-4264ac9c67ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20149ac4-78e9-4b73-b580-4264ac9c67ba', 'volume_size': 1}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f89d34-a748-458c-b6bf-254560e171d4 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03" returned: 0 in 0.670s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:34 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 is being set with open permissions: ugo+rw
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:34 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03
Apr 20 18:46:34 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:34 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.537s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:34 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Deleted volume successfully.
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-323fa9d5-056d-4d87-9f25-7fc0a3abe828 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-3d1dfa61-0576-4453-a973-a6746ba7a5e6-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:34 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-b0169469-0aa0-4ae0-8a0e-a3518056ed89-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-b0169469-0aa0-4ae0-8a0e-a3518056ed89-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-quobyte-b0169469-0aa0-4ae0-8a0e-a3518056ed89" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-b0169469-0aa0-4ae0-8a0e-a3518056ed89" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9fc478-6914-4384-9537-2f69251d31e0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:35 devstack sudo[90179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89
Apr 20 18:46:35 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:35 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:35 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info
Apr 20 18:46:35 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:35 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89" returned: 0 in 0.498s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:35 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89
Apr 20 18:46:35 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:35 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:35 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info is being set with open permissions: ugo+rw
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:35 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info
Apr 20 18:46:35 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:35 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0169469-0aa0-4ae0-8a0e-a3518056ed89" returned: 0 in 0.424s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:35 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-b0169469-0aa0-4ae0-8a0e-a3518056ed89" released by "delete_volume" :: held 0.944s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Created reservations ['069b2b24-a63b-4c7f-9c86-fb1a03ab83c7', '61e4fd03-75a0-4d30-aaaa-f888865b1479', '6b53eb27-e87e-4c5e-a91b-728d56a168c1', '88e79e00-2bc9-4f66-bec6-643e3528e1fc'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:36 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:36 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-1783a133-ba0b-412e-bf20-0f11dfffa3a2-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:36 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-1783a133-ba0b-412e-bf20-0f11dfffa3a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.info" returned: 0 in 0.431s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1185681085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:33Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating volume b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:36 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:36 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 1073741824
Apr 20 18:46:36 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-83a43e8a-65c9-4ef8-8359-2f975b67c04a tempest-VolumeDependencyTests-1447693068 None] Create snapshot completed successfully
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-quobyte-1783a133-ba0b-412e-bf20-0f11dfffa3a2" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-1783a133-ba0b-412e-bf20-0f11dfffa3a2" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e2cf9-1983-46f6-98fa-7f18121f8aa8]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:36 devstack sudo[90198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2
Apr 20 18:46:36 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:36 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.463s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:36 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Deleted volume successfully.
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7f6b7e3b-24ca-4b71-93d8-89a9fb22134c tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-b0169469-0aa0-4ae0-8a0e-a3518056ed89-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:36 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 1073741824" returned: 0 in 0.501s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:36 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86
Apr 20 18:46:36 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:36 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2" returned: 0 in 0.516s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:36 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:36 devstack sudo[90209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2
Apr 20 18:46:36 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:37 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86" returned: 0 in 0.440s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.548s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1675225940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f32b8b-1363-4541-9712-6728d2878602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:33Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating volume b8f32b8b-1363-4541-9712-6728d2878602 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:37 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:37 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602 1073741824
Apr 20 18:46:37 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:37 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0faeb5d-1d52-45c0-bf61-32501e2f2d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b8570-9782-4e64-ad09-502327d112f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-1783a133-ba0b-412e-bf20-0f11dfffa3a2" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:37 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 (b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86): created successfully
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b8570-9782-4e64-ad09-502327d112f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (d6d600a2-abd7-42b5-b6fa-e181d5b12e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-1783a133-ba0b-412e-bf20-0f11dfffa3a2" released by "delete_volume" :: held 1.005s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:37 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e4df5489-c690-4413-8c34-bb39ab4bc704 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created volume successfully.
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (4f792d4c-16ef-465a-be60-ecdeb1f79fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83afc78f-81f8-4ebe-9da2-1df0600d0f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83afc78f-81f8-4ebe-9da2-1df0600d0f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-164912388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df855e6c-6d02-43f8-9bec-2602a156d759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0729df23a84afba8338dc6c8a1ee8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98111428-e047-4c86-8adc-d7b0e4969b03,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:37Z,use_quota=True,user_id='8d019ec988824acbae7413a253333735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7660f86e-b29b-4556-b629-ca17962eea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7660f86e-b29b-4556-b629-ca17962eea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae37dd89-cf0b-40b9-b872-269488c15a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae37dd89-cf0b-40b9-b872-269488c15a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df855e6c-6d02-43f8-9bec-2602a156d759', 'volume_name': 'volume-df855e6c-6d02-43f8-9bec-2602a156d759', 'volume_size': 1, 'snapshot_id': '98111428-e047-4c86-8adc-d7b0e4969b03'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4ecbd-9942-4578-a05e-f17665642b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c4ecbd-9942-4578-a05e-f17665642b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5621ac72-4389-4935-8b76-1f220187b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:37 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Volume df855e6c-6d02-43f8-9bec-2602a156d759: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df855e6c-6d02-43f8-9bec-2602a156d759', 'volume_size': 1, 'snapshot_id': '98111428-e047-4c86-8adc-d7b0e4969b03'}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Created reservations ['4d1fd6f1-897e-45be-bed3-0f8a9ba09ea2', 'c5013343-2392-4aa2-8335-d1db718e6d02', '7f73c9b6-0ceb-48fb-9496-9bd087923d9f', '74dd0c24-d780-46da-9b88-8f7f001797a0'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:37 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:37 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:37 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602 1073741824" returned: 0 in 0.525s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:37 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602
Apr 20 18:46:37 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:37 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.442s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:37 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Deleted volume successfully.
Apr 20 18:46:37 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-7db49d33-94ed-4973-906c-e6f8a1af74a4 tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-1783a133-ba0b-412e-bf20-0f11dfffa3a2-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:38 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602" returned: 0 in 0.421s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.290s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562520571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9abfb2-8449-4202-8be2-90302d3dd019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:34Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating volume 2d9abfb2-8449-4202-8be2-90302d3dd019 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:38 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:38 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019 1073741824
Apr 20 18:46:38 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972e5410-a405-41ea-a8e8-e549b4cae52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f32b8b-1363-4541-9712-6728d2878602', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a7e83d-1a71-40f8-afdb-6941ded0556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:38 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume volume-b8f32b8b-1363-4541-9712-6728d2878602 (b8f32b8b-1363-4541-9712-6728d2878602): created successfully
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a7e83d-1a71-40f8-afdb-6941ded0556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (fe81be5f-fff1-4eac-914b-44fdda043390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:38 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-5428a6fd-7e16-4d3a-bd88-b2b60d87dec7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created volume successfully.
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-93886080-f9f4-4859-83ff-63252cf967e0-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-93886080-f9f4-4859-83ff-63252cf967e0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "cinder-quobyte-93886080-f9f4-4859-83ff-63252cf967e0" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-93886080-f9f4-4859-83ff-63252cf967e0" acquired by "delete_volume" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d88694d-e788-46f5-af3d-cff47ac63b5e]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:38 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0
Apr 20 18:46:38 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:38 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019 1073741824" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:38 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019
Apr 20 18:46:38 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:38 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0" returned: 0 in 0.479s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:38 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:38 devstack sudo[90236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0
Apr 20 18:46:38 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:39 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019" returned: 0 in 0.406s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.840s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1558627730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c03019-7ae0-4e3e-9353-90d5e7d9de60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:34Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating volume 43c03019-7ae0-4e3e-9353-90d5e7d9de60 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:39 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4792827a-5d42-4a81-9c10-ea0d56d69b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9abfb2-8449-4202-8be2-90302d3dd019', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03fe130-15ad-460f-a2c3-7b336bfddbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:39 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 1073741824
Apr 20 18:46:39 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:39 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume volume-2d9abfb2-8449-4202-8be2-90302d3dd019 (2d9abfb2-8449-4202-8be2-90302d3dd019): created successfully
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03fe130-15ad-460f-a2c3-7b336bfddbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (a00c5743-f1dd-425c-95e8-cd20f0b764c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:39 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-df42bc1f-5ca8-428c-87b6-8cb0fed9605b tempest-CreateVolumesFromSnapshotTest-793516669 None] Created volume successfully.
Apr 20 18:46:39 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-93886080-f9f4-4859-83ff-63252cf967e0" returned: 0 in 0.424s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-quobyte-93886080-f9f4-4859-83ff-63252cf967e0" released by "delete_volume" :: held 0.924s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Created reservations ['83aa15e6-935f-4815-9a91-74fe73802dff', 'f295128d-b363-4a62-a31e-a198cd287947', 'a49aba12-a7a4-4f37-94fc-2b20125303c5', 'db6aeba8-a115-49b0-a751-c3544eebb3d3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:39 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:39 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:39 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 1073741824" returned: 0 in 0.538s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:39 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60
Apr 20 18:46:39 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:39 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.482s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:39 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Deleted volume successfully.
Apr 20 18:46:39 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-586aaf6a-d6d2-4b8a-9369-ad89030accad tempest-CreateVolumesFromImageTest-1382145497 None] Lock "cinder-93886080-f9f4-4859-83ff-63252cf967e0-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:40 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.671s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1801342083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95e414bd-7939-426d-af53-562b0bfe4fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0c74eb2bd040d5ae312a4fb8ecc1ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:34Z,use_quota=True,user_id='4319f61ee41e45c5ba64b9f5b81e3ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Creating volume 95e414bd-7939-426d-af53-562b0bfe4fed {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:40 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c30969-d687-4a98-92e3-e991ab1764ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504f23f4-17ee-4536-a7fb-b383281adc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:40 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed 1073741824
Apr 20 18:46:40 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:40 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 (43c03019-7ae0-4e3e-9353-90d5e7d9de60): created successfully
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (504f23f4-17ee-4536-a7fb-b383281adc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (65af4277-2eed-4567-8550-5d99e216cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:40 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-98121bca-a231-46dc-8618-174d1fb6d841 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created volume successfully.
Apr 20 18:46:40 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed 1073741824" returned: 0 in 0.510s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:40 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:40 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed
Apr 20 18:46:40 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (a5ef1f53-a934-49dd-a1d6-52e507af2fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0535bc0-fe58-4a65-bc53-bebad0de19ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0535bc0-fe58-4a65-bc53-bebad0de19ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-453625364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f34cef-91a5-4789-b043-c086eeeb7429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:41Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb85a157-dedf-4163-9f5f-4fd8f864b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb85a157-dedf-4163-9f5f-4fd8f864b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12722ce-ae54-434a-8f33-b48190b633a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12722ce-ae54-434a-8f33-b48190b633a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f34cef-91a5-4789-b043-c086eeeb7429', 'volume_name': 'volume-44f34cef-91a5-4789-b043-c086eeeb7429', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:41 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad435f4e-4a13-4628-9da0-2163193f11a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad435f4e-4a13-4628-9da0-2163193f11a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec3f9ed-a55a-48a8-8057-65acb1f2d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume 44f34cef-91a5-4789-b043-c086eeeb7429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f34cef-91a5-4789-b043-c086eeeb7429', 'volume_size': 1}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.376s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1618910173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20149ac4-78e9-4b73-b580-4264ac9c67ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691e0a782aa64945bd9e80f13bf99ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:35Z,use_quota=True,user_id='8c462681116c4b7a9ba52683c449681f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Creating volume 20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:41 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22857795-2d90-4349-ad69-d3895422ab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95e414bd-7939-426d-af53-562b0bfe4fed', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b545eb-db4c-4d13-8a16-3727d31aed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:41 devstack sudo[90260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba 1073741824
Apr 20 18:46:41 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:41 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Volume volume-95e414bd-7939-426d-af53-562b0bfe4fed (95e414bd-7939-426d-af53-562b0bfe4fed): created successfully
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b545eb-db4c-4d13-8a16-3727d31aed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Flow 'volume_create_manager' (f858cdea-289c-461a-9f65-826f1254b709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:41 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-15fe06bd-aa37-4f0b-a7e1-c9d4c8235c12 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created volume successfully.
Apr 20 18:46:41 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba 1073741824" returned: 0 in 0.473s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:41 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:46:41 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-95e414bd-7939-426d-af53-562b0bfe4fed-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-95e414bd-7939-426d-af53-562b0bfe4fed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-95e414bd-7939-426d-af53-562b0bfe4fed" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-95e414bd-7939-426d-af53-562b0bfe4fed" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2a1fb6-53be-4ce4-9be6-4af139bbf5a0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:41 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:42 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed
Apr 20 18:46:42 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:42 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.425s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.792s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-98111428-e047-4c86-8adc-d7b0e4969b03-df855e6c-6d02-43f8-9bec-2602a156d759" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e54f73b-2d8e-4668-92a3-342c2a1a35fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20149ac4-78e9-4b73-b580-4264ac9c67ba', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ed1fc5-958e-4ee8-b3df-44e38d69ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-98111428-e047-4c86-8adc-d7b0e4969b03-df855e6c-6d02-43f8-9bec-2602a156d759" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Creating volume df855e6c-6d02-43f8-9bec-2602a156d759 from snapshot 98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-df855e6c-6d02-43f8-9bec-2602a156d759" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:42 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Volume volume-20149ac4-78e9-4b73-b580-4264ac9c67ba (20149ac4-78e9-4b73-b580-4264ac9c67ba): created successfully
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ed1fc5-958e-4ee8-b3df-44e38d69ee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Flow 'volume_create_manager' (cfaf0b9a-81f5-4508-b1ce-8836c86fc281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-df855e6c-6d02-43f8-9bec-2602a156d759" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] snapshot: 98111428-e047-4c86-8adc-d7b0e4969b03, volume: df855e6c-6d02-43f8-9bec-2602a156d759,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:46:42 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3c802b18-f425-49d3-89dc-36ec6ff75d9e tempest-SnapshotDependencyTests-1908185644 None] Created volume successfully.
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[44171762-6add-4b6b-be3b-433d03e93783]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:42 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03
Apr 20 18:46:42 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:42 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed" returned: 0 in 0.487s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:42 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed
Apr 20 18:46:42 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:42 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03" returned: 0 in 0.487s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f89d34-a748-458c-b6bf-254560e171d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a801c939-14ee-4b27-b852-b4518558f88f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:42 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:42 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:42 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-95e414bd-7939-426d-af53-562b0bfe4fed" returned: 0 in 0.402s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-95e414bd-7939-426d-af53-562b0bfe4fed" released by "delete_volume" :: held 0.912s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['d190d974-724a-4f30-b899-5061d09d6924', '3b1f5af0-f06f-4e4c-a371-6dcea6731d72', '1671e065-9265-4c67-8032-985d7c4fea0a', '52bbbd80-65d0-41b3-9d71-41c1189da533'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:42 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:42 devstack sudo[90283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:42 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-43c03019-7ae0-4e3e-9353-90d5e7d9de60-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-43c03019-7ae0-4e3e-9353-90d5e7d9de60-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-43c03019-7ae0-4e3e-9353-90d5e7d9de60" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-43c03019-7ae0-4e3e-9353-90d5e7d9de60" acquired by "delete_volume" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abcbc33-4b1d-48c9-997e-d6b6cedd815b]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:43 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.501s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:43 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759
Apr 20 18:46:43 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:43 devstack sudo[90288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60
Apr 20 18:46:43 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:43 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.478s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:43 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleted volume successfully.
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8abac549-b79d-4070-ac13-0c791eaaa576 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-95e414bd-7939-426d-af53-562b0bfe4fed-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:43 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60" returned: 0 in 0.534s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:43 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:43 devstack sudo[90299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60
Apr 20 18:46:43 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:44 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:44 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-43c03019-7ae0-4e3e-9353-90d5e7d9de60" returned: 0 in 1.012s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:44 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-43c03019-7ae0-4e3e-9353-90d5e7d9de60" released by "delete_volume" :: held 1.597s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:44 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['d68d7480-bfb9-49d0-ab59-1ccaf32f7322', '9899cc7a-119d-4465-b28a-88be14f7102e', '2445bede-25ae-4576-b1d4-851c90b1046c', '58af784b-c40e-47ef-861d-80f005217610'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:45 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:45 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:45 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759" returned: 0 in 2.139s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dc9649-e6ec-4369-abd6-5069335b1ab6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-2d9abfb2-8449-4202-8be2-90302d3dd019-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-2d9abfb2-8449-4202-8be2-90302d3dd019-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-2d9abfb2-8449-4202-8be2-90302d3dd019" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:45 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:45 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-2d9abfb2-8449-4202-8be2-90302d3dd019" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4585002f-77d1-4fbd-b711-135b5d44e1be]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:45 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019
Apr 20 18:46:45 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:45 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.613s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:45 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleted volume successfully.
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-69af0972-4f55-4093-a24f-9eb2c68bc081 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-43c03019-7ae0-4e3e-9353-90d5e7d9de60-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:45 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019" returned: 0 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:45 devstack sudo[90324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019
Apr 20 18:46:45 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:45 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.629s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4, size 1024.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:46:45 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Converted 1024.00 MB image at 478.34 MB/s
Apr 20 18:46:45 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 is being set with open permissions: ugo+rw
Apr 20 18:46:45 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:46 devstack sudo[90326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759
Apr 20 18:46:46 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:46 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2d9abfb2-8449-4202-8be2-90302d3dd019" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-2d9abfb2-8449-4202-8be2-90302d3dd019" released by "delete_volume" :: held 0.886s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['eb6e565c-fe02-41d3-9dae-8e34669a21ca', '98c712ee-1d1c-4428-8686-9d05e03353e5', '358b2381-5df7-44c5-b81c-d480dbee6b2f', 'd42fb7cc-a6e6-4c4b-8352-67b24d312e30'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:46 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759" returned: 0 in 0.401s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-df855e6c-6d02-43f8-9bec-2602a156d759" released by "_copy_volume_from_snapshot" :: held 4.244s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-98111428-e047-4c86-8adc-d7b0e4969b03-df855e6c-6d02-43f8-9bec-2602a156d759" released by "_create_volume_from_snapshot" :: held 4.279s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.311s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:46 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:46 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.248s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-453625364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f34cef-91a5-4789-b043-c086eeeb7429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:41Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Creating volume 44f34cef-91a5-4789-b043-c086eeeb7429 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:46 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:46 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429 1073741824
Apr 20 18:46:46 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5621ac72-4389-4935-8b76-1f220187b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df855e6c-6d02-43f8-9bec-2602a156d759', 'volume_size': 1, 'snapshot_id': '98111428-e047-4c86-8adc-d7b0e4969b03'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1f1346-c3f5-40b8-813d-42b0530c3f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-b8f32b8b-1363-4541-9712-6728d2878602-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:46 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Volume volume-df855e6c-6d02-43f8-9bec-2602a156d759 (df855e6c-6d02-43f8-9bec-2602a156d759): created successfully
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1f1346-c3f5-40b8-813d-42b0530c3f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (4f792d4c-16ef-465a-be60-ecdeb1f79fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-b8f32b8b-1363-4541-9712-6728d2878602-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:46 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e71fd395-c15f-46e4-a005-9b9614cfac6e tempest-VolumeDependencyTests-1447693068 None] Created volume successfully.
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-b8f32b8b-1363-4541-9712-6728d2878602" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-b8f32b8b-1363-4541-9712-6728d2878602" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd704cc-b73f-4c95-87f8-811d8c484b09]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:46 devstack sudo[90334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602
Apr 20 18:46:46 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-98111428-e047-4c86-8adc-d7b0e4969b03-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-98111428-e047-4c86-8adc-d7b0e4969b03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-63f89d34-a748-458c-b6bf-254560e171d4" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-63f89d34-a748-458c-b6bf-254560e171d4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-98111428-e047-4c86-8adc-d7b0e4969b03" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-98111428-e047-4c86-8adc-d7b0e4969b03" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Deleting offline snapshot 98111428-e047-4c86-8adc-d7b0e4969b03 of volume 63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] snapshot_file for this snap is: volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8364f-56e5-4295-8e32-57efec38996f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:46 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03
Apr 20 18:46:46 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:46 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.531s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:46 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleted volume successfully.
Apr 20 18:46:46 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429 1073741824" returned: 0 in 0.512s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-342fd792-0ab5-4108-bc11-2279ffabe8e9 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-2d9abfb2-8449-4202-8be2-90302d3dd019-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:46 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:46 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429
Apr 20 18:46:46 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:47 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602" returned: 0 in 0.527s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:47 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602
Apr 20 18:46:47 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:47 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03" returned: 0 in 0.488s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f89d34-a748-458c-b6bf-254560e171d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb12f4-32ae-4a4c-bfaf-1d7bfd081617]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:47 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429" returned: 0 in 0.417s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.013s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:47 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:47 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec3f9ed-a55a-48a8-8057-65acb1f2d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f34cef-91a5-4789-b043-c086eeeb7429', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd28b893-e9cc-4304-8218-5bd3efabcbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Creating offline snapshot eb548983-b17e-4bf3-a525-e72ce6022d29 of volume 20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:46:47 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume volume-44f34cef-91a5-4789-b043-c086eeeb7429 (44f34cef-91a5-4789-b043-c086eeeb7429): created successfully
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd28b893-e9cc-4304-8218-5bd3efabcbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (a5ef1f53-a934-49dd-a1d6-52e507af2fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee827f4-a401-435d-a231-178db0f2cd62]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:47 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-890194f1-9911-479f-8645-4d8af053cea5 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created volume successfully.
Apr 20 18:46:47 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:46:47 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:47 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b8f32b8b-1363-4541-9712-6728d2878602" returned: 0 in 0.450s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-b8f32b8b-1363-4541-9712-6728d2878602" released by "delete_volume" :: held 0.998s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['dd2b954c-d22a-4950-8c10-2007234f89df', '0b3868e8-3865-4e81-b5da-13722fc848d3', '313894f5-668a-49a7-a85e-f82435266967', '6363d9b3-6049-4887-8813-3c296773dcda'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:47 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:47 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (e1344716-8a4f-4c48-a26a-a391a84a7852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3808d402-c3da-4e86-8d6a-9585f45171d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3808d402-c3da-4e86-8d6a-9585f45171d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356889819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3555a0-891d-450f-88e7-b92ee6472828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:48Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4104baba-7f3e-4e8f-8773-5f120b55fcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4104baba-7f3e-4e8f-8773-5f120b55fcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:47 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2800194-c1b8-4d72-996e-2fd2f62020bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2800194-c1b8-4d72-996e-2fd2f62020bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3555a0-891d-450f-88e7-b92ee6472828', 'volume_name': 'volume-5f3555a0-891d-450f-88e7-b92ee6472828', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad09f50-c235-406f-a52d-b873a1f89498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad09f50-c235-406f-a52d-b873a1f89498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328c8577-54fe-4d2b-bb69-540d1e74e72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:47 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume 5f3555a0-891d-450f-88e7-b92ee6472828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3555a0-891d-450f-88e7-b92ee6472828', 'volume_size': 1}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.619s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:47 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.533s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:47 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:47 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03
Apr 20 18:46:47 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:47 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 1G
Apr 20 18:46:47 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (39fae662-544b-491b-95ff-46bfa7587ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a893a56-1717-4a4b-82c8-78e5ae762c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a893a56-1717-4a4b-82c8-78e5ae762c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293951186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378cea3e-1454-482e-8c6d-1d7dcf5482af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:48Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883454b2-ccb8-4a6f-89e5-4fae397efb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883454b2-ccb8-4a6f-89e5-4fae397efb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd08575c-cecd-473a-ad6f-97d3a5ed7403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd08575c-cecd-473a-ad6f-97d3a5ed7403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378cea3e-1454-482e-8c6d-1d7dcf5482af', 'volume_name': 'volume-378cea3e-1454-482e-8c6d-1d7dcf5482af', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4599d617-a56b-4653-9e01-35b312703028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4599d617-a56b-4653-9e01-35b312703028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09796ac1-9e8c-4782-988d-581c18034065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume 378cea3e-1454-482e-8c6d-1d7dcf5482af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378cea3e-1454-482e-8c6d-1d7dcf5482af', 'volume_size': 1}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (f3d3f1c3-dc45-4c7a-8ed7-9ca3d0d31423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0e369f-ec2b-45c7-910d-157d53bfe59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.696s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:48 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleted volume successfully.
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0e369f-ec2b-45c7-910d-157d53bfe59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918080301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc9b204-f021-4a88-abc6-7f24467b46db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:48Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6c3483-39f0-4272-b195-1be4db3ac3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6c3483-39f0-4272-b195-1be4db3ac3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29679a27-50eb-4ce1-8536-7d46eeb59ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29679a27-50eb-4ce1-8536-7d46eeb59ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc9b204-f021-4a88-abc6-7f24467b46db', 'volume_name': 'volume-2dc9b204-f021-4a88-abc6-7f24467b46db', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d74ea7-c056-4afd-8574-3965c0d8f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d74ea7-c056-4afd-8574-3965c0d8f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51fc3b-fa7b-41e5-a7ed-1aa1fdbeb6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume 2dc9b204-f021-4a88-abc6-7f24467b46db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc9b204-f021-4a88-abc6-7f24467b46db', 'volume_size': 1}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-74ae9305-836f-48e9-b29b-85068f477f83 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-b8f32b8b-1363-4541-9712-6728d2878602-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:48 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03" returned: 0 in 0.542s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:48 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03
Apr 20 18:46:48 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (f0d6958b-b8ed-48d7-800b-1fb2953364cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03e65f4-06ab-4e4d-87ea-87516c1735cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03e65f4-06ab-4e4d-87ea-87516c1735cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306232072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998bc552-31ca-4a51-81d0-0ef539055558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:49Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977fb1d6-38cb-4ad3-aebf-ac643d28a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977fb1d6-38cb-4ad3-aebf-ac643d28a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edcc9b4-0fef-460d-bf12-0f2f1472e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edcc9b4-0fef-460d-bf12-0f2f1472e80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998bc552-31ca-4a51-81d0-0ef539055558', 'volume_name': 'volume-998bc552-31ca-4a51-81d0-0ef539055558', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274b967d-9e0b-48a9-bacc-009dccffe185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (274b967d-9e0b-48a9-bacc-009dccffe185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dea00da-f428-42e6-8afb-968d307889f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume 998bc552-31ca-4a51-81d0-0ef539055558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998bc552-31ca-4a51-81d0-0ef539055558', 'volume_size': 1}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:48 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 1G" returned: 0 in 0.652s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20149ac4-78e9-4b73-b580-4264ac9c67ba -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:48 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20149ac4-78e9-4b73-b580-4264ac9c67ba -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29
Apr 20 18:46:48 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (a607a0bc-bb6e-41b9-a389-fbe5841ee81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb68e41b-a77a-4a8b-90ec-ca6a537debd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb68e41b-a77a-4a8b-90ec-ca6a537debd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178855709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e6bf0d-686d-4f42-a28f-4803a2752c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:49Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6800d711-fb24-4c46-8297-caf046b576b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6800d711-fb24-4c46-8297-caf046b576b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4132280e-de6c-43c2-8d09-44f43a72dfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4132280e-de6c-43c2-8d09-44f43a72dfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e6bf0d-686d-4f42-a28f-4803a2752c1b', 'volume_name': 'volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4506f364-2fd1-4e65-9b5d-e21a61f5d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4506f364-2fd1-4e65-9b5d-e21a61f5d959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2ccf5b-5bae-4bb0-8a8d-278797e96d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:48 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume 48e6bf0d-686d-4f42-a28f-4803a2752c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b', 'volume_size': 1}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86" acquired by "delete_volume" :: waited 0.080s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b27a23-6427-4382-8c2d-e7b23501b5f7]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:48 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86
Apr 20 18:46:48 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:48 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:48 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4.98111428-e047-4c86-8adc-d7b0e4969b03" returned: 0 in 0.511s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-98111428-e047-4c86-8adc-d7b0e4969b03" released by "_delete_snapshot" :: held 2.217s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-63f89d34-a748-458c-b6bf-254560e171d4" released by "delete_snapshot" :: held 2.229s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Created reservations ['031071f6-d907-4b35-b24f-58d14d71dae6', '19b7f043-8391-45c2-8f48-959bb13edeb3', 'daf6a960-8b12-4e5b-8953-333e6367b3ab', 'c4074e16-d102-485b-8b11-8e0c2c8d6f78'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:49 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Delete snapshot completed successfully.
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-acc0931e-d08d-4c9a-8604-b2888bfe8fdb tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-98111428-e047-4c86-8adc-d7b0e4969b03-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:49 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20149ac4-78e9-4b73-b580-4264ac9c67ba -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29" returned: 0 in 0.533s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:49 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 is being set with open permissions: ugo+rw
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:49 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29
Apr 20 18:46:49 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:49 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:49 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86
Apr 20 18:46:49 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:49 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29" returned: 0 in 0.408s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:49 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info
Apr 20 18:46:49 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:49 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86" returned: 0 in 0.410s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86" released by "delete_volume" :: held 0.942s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['4b86d15c-c894-49a8-9ced-f2176cb90cfc', '36270e56-229f-4903-964e-47e65a8ef90a', '7083b1c6-c30a-40de-a7fd-5cac1dbcd728', '366fe13e-2053-4d6f-b6f2-ed800e421672'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:49 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:49 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-63f89d34-a748-458c-b6bf-254560e171d4-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-63f89d34-a748-458c-b6bf-254560e171d4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-63f89d34-a748-458c-b6bf-254560e171d4" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-63f89d34-a748-458c-b6bf-254560e171d4" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897168b-efd2-43ba-84cc-9db46b64c98a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:49 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:50 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info" returned: 0 in 0.439s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:50 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info is being set with open permissions: ugo+rw
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:50 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info
Apr 20 18:46:50 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:50 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:50 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:50 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleted volume successfully.
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3396426e-ace0-4289-aa69-82d1b824653f tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-b0a5b1d5-fd7a-4a6d-80ee-368605a0cc86-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:50 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.info" returned: 0 in 0.415s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.509s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:50 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1356889819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3555a0-891d-450f-88e7-b92ee6472828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:48Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Creating volume 5f3555a0-891d-450f-88e7-b92ee6472828 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:50 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.493s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:50 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828 1073741824
Apr 20 18:46:50 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:50 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4
Apr 20 18:46:50 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:50 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-69de152e-2c31-4436-b49e-397f8a28fcda tempest-SnapshotDependencyTests-1908185644 None] Create snapshot completed successfully
Apr 20 18:46:50 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-63f89d34-a748-458c-b6bf-254560e171d4" returned: 0 in 0.454s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-faac07fc-7f5f-4c82-9f05-f64539b7e0c2-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-63f89d34-a748-458c-b6bf-254560e171d4" released by "delete_volume" :: held 0.983s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-faac07fc-7f5f-4c82-9f05-f64539b7e0c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-0d5cc748-78e7-4ca0-a5dc-587286293530" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-0d5cc748-78e7-4ca0-a5dc-587286293530" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-faac07fc-7f5f-4c82-9f05-f64539b7e0c2" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:50 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-faac07fc-7f5f-4c82-9f05-f64539b7e0c2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleting offline snapshot faac07fc-7f5f-4c82-9f05-f64539b7e0c2 of volume 0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] snapshot_file for this snap is: volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Flow 'volume_create_manager' (1e9c9f4e-f098-43b9-8455-38aee3746e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b07cc42-7c48-42b2-a8e4-6a5b63381ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b2b3a8-cf79-4fac-bec4-1dd20ec73dfd]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:51 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Created reservations ['b24f2ec9-b6e6-468c-b887-258e0f170c14', '48096f73-03f9-4939-a4fd-3e25ff58ead7', '42c9e8e6-a0b9-41a1-abd5-787e5700a3a5', 'd44be1cc-df57-41a1-b233-a7ee00a1573b'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b07cc42-7c48-42b2-a8e4-6a5b63381ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ddd533-4804-42dd-80c4-80bed5ecc3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691e0a782aa64945bd9e80f13bf99ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb548983-b17e-4bf3-a525-e72ce6022d29,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:51Z,use_quota=True,user_id='8c462681116c4b7a9ba52683c449681f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7095401a-6c8c-4971-88e1-462ebbad6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7095401a-6c8c-4971-88e1-462ebbad6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdffcb6-ff48-4705-9b14-56d89d52585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdffcb6-ff48-4705-9b14-56d89d52585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50ddd533-4804-42dd-80c4-80bed5ecc3b6', 'volume_name': 'volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6', 'volume_size': 1, 'snapshot_id': 'eb548983-b17e-4bf3-a525-e72ce6022d29'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fd54a7-5b72-45a9-83da-362e57eab6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fd54a7-5b72-45a9-83da-362e57eab6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd09627c-4d0b-4d78-97af-e8da3942a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:51 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Volume 50ddd533-4804-42dd-80c4-80bed5ecc3b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6', 'volume_size': 1, 'snapshot_id': 'eb548983-b17e-4bf3-a525-e72ce6022d29'}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828 1073741824" returned: 0 in 0.638s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:51 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:51 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:51 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:51 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:51 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:51 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:51 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2" returned: 0 in 0.471s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d5cc748-78e7-4ca0-a5dc-587286293530(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[441ce62d-50fa-4720-9eaa-26c64cd65aae]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:51 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828" returned: 0 in 0.422s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.377s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1293951186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378cea3e-1454-482e-8c6d-1d7dcf5482af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:48Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Creating volume 378cea3e-1454-482e-8c6d-1d7dcf5482af {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:51 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:51 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328c8577-54fe-4d2b-bb69-540d1e74e72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3555a0-891d-450f-88e7-b92ee6472828', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:51 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af 1073741824
Apr 20 18:46:51 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dcee98-8065-4414-a126-36187aea1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:51 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530
Apr 20 18:46:51 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:51 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Deleted volume successfully.
Apr 20 18:46:51 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume volume-5f3555a0-891d-450f-88e7-b92ee6472828 (5f3555a0-891d-450f-88e7-b92ee6472828): created successfully
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5dcee98-8065-4414-a126-36187aea1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (e1344716-8a4f-4c48-a26a-a391a84a7852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:51 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4d99b85f-d260-4cc2-a1f6-a366f180f716 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created volume successfully.
Apr 20 18:46:51 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-e319517f-cf53-49a3-8d66-a415ae098043 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-63f89d34-a748-458c-b6bf-254560e171d4-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:52 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530" returned: 0 in 0.535s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:52 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2
Apr 20 18:46:52 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:52 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af 1073741824" returned: 0 in 0.535s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:52 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af
Apr 20 18:46:52 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (e4d4866b-5501-4761-931a-9c95472b3199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684e10fa-2e22-43ef-a0e0-920ea979c1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (684e10fa-2e22-43ef-a0e0-920ea979c1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1122766172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8784f8af-73fe-4a77-8559-55390ea12cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0729df23a84afba8338dc6c8a1ee8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:52Z,use_quota=True,user_id='8d019ec988824acbae7413a253333735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdfd193-b2b1-4b10-9f37-ea3edb1a8fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdfd193-b2b1-4b10-9f37-ea3edb1a8fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c0cd67-a9de-4483-a855-06c3cc7edd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c0cd67-a9de-4483-a855-06c3cc7edd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8784f8af-73fe-4a77-8559-55390ea12cb8', 'volume_name': 'volume-8784f8af-73fe-4a77-8559-55390ea12cb8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eec9ddb-eb98-49b5-9499-faa53be2c9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eec9ddb-eb98-49b5-9499-faa53be2c9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6838b3b5-13e1-4b60-9220-b13924488c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:52 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Volume 8784f8af-73fe-4a77-8559-55390ea12cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8784f8af-73fe-4a77-8559-55390ea12cb8', 'volume_size': 1}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:52 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2" returned: 0 in 0.445s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:52 devstack sudo[90448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2
Apr 20 18:46:52 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:52 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.183s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-918080301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc9b204-f021-4a88-abc6-7f24467b46db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:48Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Creating volume 2dc9b204-f021-4a88-abc6-7f24467b46db {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:52 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09796ac1-9e8c-4782-988d-581c18034065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378cea3e-1454-482e-8c6d-1d7dcf5482af', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e982fa7a-fba1-4f1f-8335-e7184b6ab232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:52 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db 1073741824
Apr 20 18:46:52 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:52 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume volume-378cea3e-1454-482e-8c6d-1d7dcf5482af (378cea3e-1454-482e-8c6d-1d7dcf5482af): created successfully
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e982fa7a-fba1-4f1f-8335-e7184b6ab232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (39fae662-544b-491b-95ff-46bfa7587ecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:52 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-c13ec054-67d6-4c55-b3c7-4beb7e663c45 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created volume successfully.
Apr 20 18:46:52 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530.faac07fc-7f5f-4c82-9f05-f64539b7e0c2" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-faac07fc-7f5f-4c82-9f05-f64539b7e0c2" released by "_delete_snapshot" :: held 1.948s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-0d5cc748-78e7-4ca0-a5dc-587286293530" released by "delete_snapshot" :: held 1.975s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:52 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['58369394-0429-48db-baec-014f932ba490', '97d7a123-3c31-4973-85e0-a82a47a7da6e', 'a84b723a-be93-4b9a-8d01-ef7b73b5107b', 'a6d87085-a1fa-4af2-930f-33bab28636f2'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Delete snapshot completed successfully.
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-4db1fdec-59a5-4099-9cd1-108df21050f7 tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-faac07fc-7f5f-4c82-9f05-f64539b7e0c2-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-0d5cc748-78e7-4ca0-a5dc-587286293530-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-0d5cc748-78e7-4ca0-a5dc-587286293530-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "cinder-quobyte-0d5cc748-78e7-4ca0-a5dc-587286293530" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-0d5cc748-78e7-4ca0-a5dc-587286293530" acquired by "delete_volume" :: waited 0.006s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e1fc11-8248-420a-ab80-297b06cd45dc]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:53 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db 1073741824" returned: 0 in 0.547s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:53 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db
Apr 20 18:46:53 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:53 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530
Apr 20 18:46:53 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:53 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db" returned: 0 in 0.389s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.960s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306232072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998bc552-31ca-4a51-81d0-0ef539055558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:49Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Creating volume 998bc552-31ca-4a51-81d0-0ef539055558 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:53 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:53 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530" returned: 0 in 0.461s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:53 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558 1073741824
Apr 20 18:46:53 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc51fc3b-fa7b-41e5-a7ed-1aa1fdbeb6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc9b204-f021-4a88-abc6-7f24467b46db', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb44d93-4420-46a9-b378-d20faa64eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:53 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530
Apr 20 18:46:53 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:53 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume volume-2dc9b204-f021-4a88-abc6-7f24467b46db (2dc9b204-f021-4a88-abc6-7f24467b46db): created successfully
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb44d93-4420-46a9-b378-d20faa64eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (f3d3f1c3-dc45-4c7a-8ed7-9ca3d0d31423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:53 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-ebf8b084-a7de-432e-bfe8-76da3da43ca1 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created volume successfully.
Apr 20 18:46:53 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-0d5cc748-78e7-4ca0-a5dc-587286293530" returned: 0 in 0.394s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:53 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-quobyte-0d5cc748-78e7-4ca0-a5dc-587286293530" released by "delete_volume" :: held 0.890s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:54 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558 1073741824" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Created reservations ['a94bf03a-08a4-4d45-ab58-5aedfa7bdfac', '8817d418-4099-4572-b2cf-3740d31f7e29', '1617656a-abcb-4cab-a1e7-15595090d1c2', '2e5e2aad-b5e2-4f20-bbb1-7b936bc6146c'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:54 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558
Apr 20 18:46:54 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:54 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:54 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:54 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.698s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178855709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e6bf0d-686d-4f42-a28f-4803a2752c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab222274d0ac40489a95fb04014e093a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:49Z,use_quota=True,user_id='d82042f8bda542b9bca8f97908cfcb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Creating volume 48e6bf0d-686d-4f42-a28f-4803a2752c1b {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:54 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dea00da-f428-42e6-8afb-968d307889f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998bc552-31ca-4a51-81d0-0ef539055558', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:54 devstack sudo[90478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b 1073741824
Apr 20 18:46:54 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1eaee6-2385-44d6-a56c-c450d89dac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:54 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:54 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume volume-998bc552-31ca-4a51-81d0-0ef539055558 (998bc552-31ca-4a51-81d0-0ef539055558): created successfully
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1eaee6-2385-44d6-a56c-c450d89dac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (f0d6958b-b8ed-48d7-800b-1fb2953364cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:54 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Deleted volume successfully.
Apr 20 18:46:54 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-443957ab-d358-4b3b-8f20-62fc5cfe8f4a tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created volume successfully.
Apr 20 18:46:54 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-86e89284-5f36-4080-ae05-751fcac78d2b tempest-CreateVolumesFromSnapshotTest-793516669 None] Lock "cinder-0d5cc748-78e7-4ca0-a5dc-587286293530-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:55 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b 1073741824" returned: 0 in 0.590s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:55 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b
Apr 20 18:46:55 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:55 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b" returned: 0 in 0.420s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.480s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-quobyte-eb548983-b17e-4bf3-a525-e72ce6022d29-50ddd533-4804-42dd-80c4-80bed5ecc3b6" by "_create_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2ccf5b-5bae-4bb0-8a8d-278797e96d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a57ff-f556-425d-ab4d-d0438d2df3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-eb548983-b17e-4bf3-a525-e72ce6022d29-50ddd533-4804-42dd-80c4-80bed5ecc3b6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Creating volume 50ddd533-4804-42dd-80c4-80bed5ecc3b6 from snapshot eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-quobyte-50ddd533-4804-42dd-80c4-80bed5ecc3b6" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Volume volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b (48e6bf0d-686d-4f42-a28f-4803a2752c1b): created successfully
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a57ff-f556-425d-ab4d-d0438d2df3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Flow 'volume_create_manager' (a607a0bc-bb6e-41b9-a389-fbe5841ee81e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-50ddd533-4804-42dd-80c4-80bed5ecc3b6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] snapshot: eb548983-b17e-4bf3-a525-e72ce6022d29, volume: 50ddd533-4804-42dd-80c4-80bed5ecc3b6,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:55 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-076ebd21-e1b8-463c-828d-b95b97eabffe tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created volume successfully.
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb030268-18a3-4c51-8da5-8b174889aa66]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:55 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29
Apr 20 18:46:55 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Flow 'volume_create_manager' (489a98d4-6069-440a-b177-b1455a13e24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b98867-fc00-41f3-ac00-fcce4c82bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b98867-fc00-41f3-ac00-fcce4c82bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2869dc7d-841b-418e-96f0-4a31a0ff1525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697c445fd1e94c7b9674d545f20e6660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:56Z,use_quota=True,user_id='03d72e42fe264736aec8c15355fbba39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff8cc8d-2720-4851-a259-5efcc6d9772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff8cc8d-2720-4851-a259-5efcc6d9772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60adf5bf-17b0-4484-be73-fc1d6310e861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60adf5bf-17b0-4484-be73-fc1d6310e861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2869dc7d-841b-418e-96f0-4a31a0ff1525', 'volume_name': 'volume-2869dc7d-841b-418e-96f0-4a31a0ff1525', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fab5f31-de64-4400-a242-41f32ed8e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fab5f31-de64-4400-a242-41f32ed8e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402a9121-e7cd-4ffa-9d79-1523c8ab64de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:55 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Volume 2869dc7d-841b-418e-96f0-4a31a0ff1525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2869dc7d-841b-418e-96f0-4a31a0ff1525', 'volume_size': 1}
Apr 20 18:46:55 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:56 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29" returned: 0 in 0.492s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20149ac4-78e9-4b73-b580-4264ac9c67ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[942103eb-cc13-4583-9863-342c9a5bfe01]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:56 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:46:56 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-48e6bf0d-686d-4f42-a28f-4803a2752c1b-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-48e6bf0d-686d-4f42-a28f-4803a2752c1b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-quobyte-48e6bf0d-686d-4f42-a28f-4803a2752c1b" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-48e6bf0d-686d-4f42-a28f-4803a2752c1b" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e466bd-7ff1-480b-93aa-938661f6796c]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:56 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b
Apr 20 18:46:56 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:56 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.489s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:56 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6
Apr 20 18:46:56 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:56 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b" returned: 0 in 0.465s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:56 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:56 devstack sudo[90503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b
Apr 20 18:46:56 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:57 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-48e6bf0d-686d-4f42-a28f-4803a2752c1b" returned: 0 in 0.661s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-48e6bf0d-686d-4f42-a28f-4803a2752c1b" released by "delete_volume" :: held 1.158s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=152,cinder:UPDATE=205,cinder:INSERT=52,cinder:DELETE=21 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=214,cinder:SELECT=160,cinder:INSERT=45,cinder:DELETE=20 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created reservations ['64bc1372-fe8a-4970-8189-db34a8136d7b', 'd49ca9ff-c0c3-422e-9ebe-5dc5b31eed29', '14a7f93d-752e-45e9-9ea5-1c5fefc49fc9', 'cf53f932-ea2b-4989-b17a-26c50a1bc869'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:57 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:57 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:57 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-998bc552-31ca-4a51-81d0-0ef539055558-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-998bc552-31ca-4a51-81d0-0ef539055558-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-quobyte-998bc552-31ca-4a51-81d0-0ef539055558" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-998bc552-31ca-4a51-81d0-0ef539055558" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fd7762-c183-413d-9b64-8893202f379a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:58 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 1.131s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:46:58 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Deleted volume successfully.
Apr 20 18:46:58 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6" returned: 0 in 2.133s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:58 devstack sudo[90519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558
Apr 20 18:46:58 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb63a228-78bf-43c0-a81b-2a848f2d9903]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:58 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-066a90ad-7270-41b5-be95-8e3d89c5401c tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-48e6bf0d-686d-4f42-a28f-4803a2752c1b-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:58 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:46:58 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:59 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:59 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558
Apr 20 18:46:59 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:59 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.584s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:46:59 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Converted 1024.00 MB image at 479.92 MB/s
Apr 20 18:46:59 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 is being set with open permissions: ugo+rw
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:59 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6
Apr 20 18:46:59 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:59 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-998bc552-31ca-4a51-81d0-0ef539055558" returned: 0 in 0.415s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-998bc552-31ca-4a51-81d0-0ef539055558" released by "delete_volume" :: held 0.935s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created reservations ['cc5aeecf-7b5e-4a00-be4c-4f5d20156d11', '212f5be8-ff82-4179-ac75-112003ff9e2e', '7927725b-8eb7-4ab0-962e-5f4a04e77e68', '92961f12-8d5e-4aae-8a1b-7577351eca7a'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:59 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:46:59 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-2dc9b204-f021-4a88-abc6-7f24467b46db-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-2dc9b204-f021-4a88-abc6-7f24467b46db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:59 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6" returned: 0 in 0.430s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-50ddd533-4804-42dd-80c4-80bed5ecc3b6" released by "_copy_volume_from_snapshot" :: held 4.188s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-quobyte-2dc9b204-f021-4a88-abc6-7f24467b46db" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-eb548983-b17e-4bf3-a525-e72ce6022d29-50ddd533-4804-42dd-80c4-80bed5ecc3b6" released by "_create_volume_from_snapshot" :: held 4.223s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.243s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.474s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1122766172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8784f8af-73fe-4a77-8559-55390ea12cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0729df23a84afba8338dc6c8a1ee8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:52Z,use_quota=True,user_id='8d019ec988824acbae7413a253333735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Creating volume 8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:46:59 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:59 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 1073741824
Apr 20 18:46:59 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd09627c-4d0b-4d78-97af-e8da3942a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6', 'volume_size': 1, 'snapshot_id': 'eb548983-b17e-4bf3-a525-e72ce6022d29'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e30f875-8e0e-49bf-aee4-84c3e2e555cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-2dc9b204-f021-4a88-abc6-7f24467b46db" acquired by "delete_volume" :: waited 0.053s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:46:59 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Volume volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 (50ddd533-4804-42dd-80c4-80bed5ecc3b6): created successfully
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e30f875-8e0e-49bf-aee4-84c3e2e555cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Flow 'volume_create_manager' (1e9c9f4e-f098-43b9-8455-38aee3746e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ba614-ef05-4e38-9b66-cc47cb7fa8f8]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:46:59 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:46:59 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-016797d9-b05e-4d3c-90bd-a16e7b6bd7aa tempest-SnapshotDependencyTests-1908185644 None] Created volume successfully.
Apr 20 18:46:59 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db
Apr 20 18:46:59 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:00 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Deleted volume successfully.
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3e0e3aff-5ad1-4cbb-9732-7776e13e12c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-998bc552-31ca-4a51-81d0-0ef539055558-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:00 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 1073741824" returned: 0 in 0.481s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:00 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:00 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:00 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db" returned: 0 in 0.530s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:00 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db
Apr 20 18:47:00 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-eb548983-b17e-4bf3-a525-e72ce6022d29-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-eb548983-b17e-4bf3-a525-e72ce6022d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-quobyte-20149ac4-78e9-4b73-b580-4264ac9c67ba" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-20149ac4-78e9-4b73-b580-4264ac9c67ba" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-quobyte-eb548983-b17e-4bf3-a525-e72ce6022d29" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-eb548983-b17e-4bf3-a525-e72ce6022d29" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Deleting offline snapshot eb548983-b17e-4bf3-a525-e72ce6022d29 of volume 20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] snapshot_file for this snap is: volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[b207f76e-5e9c-4a39-b401-7e5b44bff330]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:00 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29
Apr 20 18:47:00 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:00 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.464s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.957s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2869dc7d-841b-418e-96f0-4a31a0ff1525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697c445fd1e94c7b9674d545f20e6660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:46:56Z,use_quota=True,user_id='03d72e42fe264736aec8c15355fbba39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Creating volume 2869dc7d-841b-418e-96f0-4a31a0ff1525 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:47:00 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6838b3b5-13e1-4b60-9220-b13924488c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8784f8af-73fe-4a77-8559-55390ea12cb8', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:00 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 1073741824
Apr 20 18:47:00 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61043fda-f2c1-4f08-a0d1-e90466407440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:00 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Volume volume-8784f8af-73fe-4a77-8559-55390ea12cb8 (8784f8af-73fe-4a77-8559-55390ea12cb8): created successfully
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61043fda-f2c1-4f08-a0d1-e90466407440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (e4d4866b-5501-4761-931a-9c95472b3199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:47:00 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-261144bb-41ee-4208-8c28-c0ed9bbcade0 tempest-VolumeDependencyTests-1447693068 None] Created volume successfully.
Apr 20 18:47:00 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2dc9b204-f021-4a88-abc6-7f24467b46db" returned: 0 in 0.493s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-2dc9b204-f021-4a88-abc6-7f24467b46db" released by "delete_volume" :: held 1.055s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:00 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created reservations ['a0e47fe6-1deb-41bc-a7e9-32dd5d61ad18', '21ef6be6-7cbb-4f32-a54b-7ba7ba4ae7dd', '2aed379f-697f-4ff6-9d29-4c428f99d688', 'df58d95e-4ee0-4265-96c9-d58623360e20'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:01 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:01 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:01 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29" returned: 0 in 0.521s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20149ac4-78e9-4b73-b580-4264ac9c67ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[1039b889-d634-4eb0-ba19-573b7d9bf10d]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:01 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 1073741824" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:01 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:47:01 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:01 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525
Apr 20 18:47:01 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:01 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.403s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Deleted volume successfully.
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-096a1d89-8379-494b-b0d1-11e212d4393d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-2dc9b204-f021-4a88-abc6-7f24467b46db-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:01 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:01 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:01 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29
Apr 20 18:47:01 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402a9121-e7cd-4ffa-9d79-1523c8ab64de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2869dc7d-841b-418e-96f0-4a31a0ff1525', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbbf35d-3d20-431f-9039-3a66e877ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:01 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Volume volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 (2869dc7d-841b-418e-96f0-4a31a0ff1525): created successfully
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbbf35d-3d20-431f-9039-3a66e877ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Flow 'volume_create_manager' (489a98d4-6069-440a-b177-b1455a13e24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:47:01 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-58ab47b8-7dd8-476b-a80c-74976d031b2a tempest-CinderUnicodeTest-1219430305 None] Created volume successfully.
Apr 20 18:47:01 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-378cea3e-1454-482e-8c6d-1d7dcf5482af-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-378cea3e-1454-482e-8c6d-1d7dcf5482af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-quobyte-378cea3e-1454-482e-8c6d-1d7dcf5482af" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-378cea3e-1454-482e-8c6d-1d7dcf5482af" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0072f-707f-4ac8-bee7-f164e368987a]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:02 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af
Apr 20 18:47:02 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (df82a682-1f1a-4664-97b2-b638ab995260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699cf430-dc34-4b22-8542-ddbf2b0a3a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699cf430-dc34-4b22-8542-ddbf2b0a3a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1790134155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03284bd6-5ec0-4b19-8d6b-e10e3ac098d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c0729df23a84afba8338dc6c8a1ee8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=8784f8af-73fe-4a77-8559-55390ea12cb8,status='creating',terminated_at=None,updated_at=2026-04-20T16:47:02Z,use_quota=True,user_id='8d019ec988824acbae7413a253333735',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57747d9-2bb2-45d5-96d2-275ecaf0c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57747d9-2bb2-45d5-96d2-275ecaf0c956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f28480-5b90-4e4b-811b-5ab29189ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f28480-5b90-4e4b-811b-5ab29189ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03284bd6-5ec0-4b19-8d6b-e10e3ac098d5', 'volume_name': 'volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5', 'volume_size': 1, 'source_volid': '8784f8af-73fe-4a77-8559-55390ea12cb8', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96e4a0a-5834-4124-837a-978657066a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96e4a0a-5834-4124-837a-978657066a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b18b9b-a3b7-42bc-885b-59b89e022608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Volume 03284bd6-5ec0-4b19-8d6b-e10e3ac098d5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5', 'volume_size': 1, 'source_volid': '8784f8af-73fe-4a77-8559-55390ea12cb8', 'source_volstatus': 'available'}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:02 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Cloning volume 8784f8af-73fe-4a77-8559-55390ea12cb8 to volume 03284bd6-5ec0-4b19-8d6b-e10e3ac098d5
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Creating offline snapshot 406a0cac-d7a7-42e6-83f8-f119e1dc44f8 of volume 8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e701c0e-449e-4ff1-bf77-9ce6ea64cba9]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:02 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29" returned: 0 in 0.551s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:02 devstack sudo[90584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29
Apr 20 18:47:02 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:02 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:02 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_service.periodic_task [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82268) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:02 devstack sudo[90587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:02 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82268) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Flow 'volume_create_manager' (f664ead8-7cba-4a67-8fe8-39ebf277eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa45157-0201-4801-bf63-b723630ff4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa45157-0201-4801-bf63-b723630ff4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:47:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-207352866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd29d03-d9f5-4574-9444-c339f76ef6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697c445fd1e94c7b9674d545f20e6660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:47:03Z,use_quota=True,user_id='03d72e42fe264736aec8c15355fbba39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf4bbf-9947-4f7f-b8e1-1b612462f19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bf4bbf-9947-4f7f-b8e1-1b612462f19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288633a4-ae41-48f5-bad2-4969094d3e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288633a4-ae41-48f5-bad2-4969094d3e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd29d03-d9f5-4574-9444-c339f76ef6c1', 'volume_name': 'volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49636931-d02f-4bc5-9473-07b93d8acf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49636931-d02f-4bc5-9473-07b93d8acf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a931fc7-c5ce-44c4-8910-64e1aca3afdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:02 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Volume 7cd29d03-d9f5-4574-9444-c339f76ef6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1', 'volume_size': 1}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:02 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba.eb548983-b17e-4bf3-a525-e72ce6022d29" returned: 0 in 0.446s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-eb548983-b17e-4bf3-a525-e72ce6022d29" released by "_delete_snapshot" :: held 2.046s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-20149ac4-78e9-4b73-b580-4264ac9c67ba" released by "delete_snapshot" :: held 2.066s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:02 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:02 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.448s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-12516cc5-9fa9-4976-a12c-b18e9c9416b6 None None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af" returned: 0 in 0.768s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Created reservations ['04cf142d-e947-4dfc-9f83-f9da003c19d9', '441012a3-047e-4185-b9d8-7e585633fba8', '92a5d4ee-d986-415e-9840-26a09d5d4a8f', '119150fc-367f-49b0-9704-8ac8721f6be6'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:02 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af
Apr 20 18:47:02 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:02 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Delete snapshot completed successfully.
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-32c54bd9-093f-4587-ae61-c5f58ce6ecdf tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-eb548983-b17e-4bf3-a525-e72ce6022d29-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:02 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.609s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:02 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:02 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 1G
Apr 20 18:47:02 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:03 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-378cea3e-1454-482e-8c6d-1d7dcf5482af" returned: 0 in 0.421s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-378cea3e-1454-482e-8c6d-1d7dcf5482af" released by "delete_volume" :: held 1.215s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created reservations ['bed6e2b9-4139-461d-87b7-a1cf8f0c6b5a', '6f3a94fa-c64c-4535-b12a-6857948567ae', '4910868a-263c-4b87-9b0c-370351352993', '5a19438d-3341-48b0-bbab-6badf52cd1b2'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:03 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:03 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:03 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 1G" returned: 0 in 0.490s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784f8af-73fe-4a77-8559-55390ea12cb8 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:03 devstack sudo[90607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784f8af-73fe-4a77-8559-55390ea12cb8 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8
Apr 20 18:47:03 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:03 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.413s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:03 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Deleted volume successfully.
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-50cc645f-b2f0-4584-bc2c-ccdcc079ac1d tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-378cea3e-1454-482e-8c6d-1d7dcf5482af-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:03 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8784f8af-73fe-4a77-8559-55390ea12cb8 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8" returned: 0 in 0.441s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:03 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 is being set with open permissions: ugo+rw
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:03 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8
Apr 20 18:47:03 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-20149ac4-78e9-4b73-b580-4264ac9c67ba-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-20149ac4-78e9-4b73-b580-4264ac9c67ba-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-quobyte-20149ac4-78e9-4b73-b580-4264ac9c67ba" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-20149ac4-78e9-4b73-b580-4264ac9c67ba" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3c9860-b47d-4942-b482-67b99fea05af]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:03 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:03 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:47:03 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-5f3555a0-891d-450f-88e7-b92ee6472828-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-5f3555a0-891d-450f-88e7-b92ee6472828-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-quobyte-5f3555a0-891d-450f-88e7-b92ee6472828" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-5f3555a0-891d-450f-88e7-b92ee6472828" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47779bf-43f1-4fa3-9290-6a58b9d3dee4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:04 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8" returned: 0 in 0.453s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:04 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info
Apr 20 18:47:04 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828
Apr 20 18:47:04 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.498s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:04 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba
Apr 20 18:47:04 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info" returned: 0 in 0.429s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:04 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info is being set with open permissions: ugo+rw
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:04 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828" returned: 0 in 0.469s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:04 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info
Apr 20 18:47:04 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828
Apr 20 18:47:04 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-20149ac4-78e9-4b73-b580-4264ac9c67ba" returned: 0 in 0.401s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-20149ac4-78e9-4b73-b580-4264ac9c67ba" released by "delete_volume" :: held 0.939s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Created reservations ['90b69b1c-a4c5-4387-915b-5bb37a92d193', '50e032ab-0677-4370-8efd-bd5ea4f90622', '62573b4d-6c92-45d8-a581-fdf2d873acc1', '97c718ca-c741-4450-9aff-80e15c9c46f3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:04 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:04 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-50ddd533-4804-42dd-80c4-80bed5ecc3b6-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:04 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-50ddd533-4804-42dd-80c4-80bed5ecc3b6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "cinder-quobyte-50ddd533-4804-42dd-80c4-80bed5ecc3b6" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-50ddd533-4804-42dd-80c4-80bed5ecc3b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[806f8831-a36d-4f78-b319-d6dea4386208]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6
Apr 20 18:47:05 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:05 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.info" returned: 0 in 0.429s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" by "_copy_volume_from_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] snapshot: 406a0cac-d7a7-42e6-83f8-f119e1dc44f8, volume: 03284bd6-5ec0-4b19-8d6b-e10e3ac098d5,  {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b155f2-0d1f-47c3-a0f7-001a67d76ee4]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-5f3555a0-891d-450f-88e7-b92ee6472828" returned: 0 in 0.472s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-5f3555a0-891d-450f-88e7-b92ee6472828" released by "delete_volume" :: held 0.975s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created reservations ['5c86dd28-f187-480f-9423-d46053ef808b', '9a8238fc-69be-4527-b081-0ec0177a3bd3', '71b2be0b-4105-4562-90fe-ba67d915084d', 'e6767cbe-23d3-4103-8d85-ce0f35c95ebe'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:05 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:05 devstack sudo[90642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8
Apr 20 18:47:05 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-44f34cef-91a5-4789-b043-c086eeeb7429-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-44f34cef-91a5-4789-b043-c086eeeb7429-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:05 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.470s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Deleted volume successfully.
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "cinder-quobyte-44f34cef-91a5-4789-b043-c086eeeb7429" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-30b282d4-3d2e-4652-9a02-92327bba7f50 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-20149ac4-78e9-4b73-b580-4264ac9c67ba-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-44f34cef-91a5-4789-b043-c086eeeb7429" acquired by "delete_volume" :: waited 0.017s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e593c-dcbf-4cce-b8c0-33c4255a7703]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429
Apr 20 18:47:05 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:05 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6" returned: 0 in 0.534s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6
Apr 20 18:47:05 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:05 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.462s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:05 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Deleted volume successfully.
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-18c33f98-83f4-49e1-8276-5f0da77f1d5e tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-5f3555a0-891d-450f-88e7-b92ee6472828-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:05 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8" returned: 0 in 0.657s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784f8af-73fe-4a77-8559-55390ea12cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] will copy from snapshot at /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Creating direct copy from snapshot {{(pid=82268) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea13e937-0622-4b6f-91ac-6f47c50889e6]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:05 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:05 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429" returned: 0 in 0.515s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:05 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:05 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429
Apr 20 18:47:05 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:06 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-50ddd533-4804-42dd-80c4-80bed5ecc3b6" returned: 0 in 0.475s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-quobyte-50ddd533-4804-42dd-80c4-80bed5ecc3b6" released by "delete_volume" :: held 1.035s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Created reservations ['9efe0614-3714-4043-b1eb-2c821ec50dc5', 'df3a00a5-0cb5-4b35-83d4-e846616a07a5', 'e2063a93-44de-4138-869a-c714096a5d78', '97806a31-4e18-47a2-ac87-d2f21c60bdd3'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:06 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:06 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:06 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.506s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.utils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Path /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 not found in is_blk_device check {{(pid=82268) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:06 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5
Apr 20 18:47:06 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:06 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-44f34cef-91a5-4789-b043-c086eeeb7429" returned: 0 in 0.443s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-quobyte-44f34cef-91a5-4789-b043-c086eeeb7429" released by "delete_volume" :: held 0.981s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Created reservations ['cd43b4d1-90e5-4027-b2b1-987eb6b94ef3', '957f8b6d-b059-4d5d-8547-cbe20327b2c4', '80ce590d-38ff-471b-b362-f499cc52163c', '0ce15a02-818d-4309-9b6d-74b093361697'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:06 devstack sudo[90675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:06 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:06 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.420s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:06 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Deleted volume successfully.
Apr 20 18:47:06 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-cd267d00-2d58-40e1-af2b-d83f1012c549 tempest-SnapshotDependencyTests-1908185644 None] Lock "cinder-50ddd533-4804-42dd-80c4-80bed5ecc3b6-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:07 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:07 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.977s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:07 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:07 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Deleted volume successfully.
Apr 20 18:47:07 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-abbbb3be-33f0-4508-bbd1-e083f69676c7 tempest-CreateVolumesFromSourceVolumeTest-529048311 None] Lock "cinder-44f34cef-91a5-4789-b043-c086eeeb7429-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:08 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" returned: 0 in 2.272s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:08 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f54721-90ff-4677-a30e-a2aeef348835]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:08 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:08 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:08 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:09 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.759s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG cinder.image.image_utils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Image conversion details: src /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 {{(pid=82268) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 18:47:09 devstack cinder-volume[82268]: INFO cinder.image.image_utils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Converted 1024.00 MB image at 450.45 MB/s
Apr 20 18:47:09 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 is being set with open permissions: ugo+rw
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:09 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5
Apr 20 18:47:09 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:09 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" returned: 0 in 0.510s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" released by "_copy_volume_from_snapshot" :: held 4.758s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-406a0cac-d7a7-42e6-83f8-f119e1dc44f8" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-406a0cac-d7a7-42e6-83f8-f119e1dc44f8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Deleting offline snapshot 406a0cac-d7a7-42e6-83f8-f119e1dc44f8 of volume 8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] snapshot_file for this snap is: volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c7ab95-b768-4123-a686-8c57f0bb6672]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:09 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:10 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8
Apr 20 18:47:10 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:10 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8" returned: 0 in 0.501s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:10 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8784f8af-73fe-4a77-8559-55390ea12cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:47:10 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f990570-b64c-4cc3-ad86-3bfe4b0cbbe2]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:10 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:10 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:10 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:11 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.573s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:11 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8
Apr 20 18:47:11 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:11 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8" returned: 0 in 0.481s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:11 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8
Apr 20 18:47:11 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:11 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:11 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8.406a0cac-d7a7-42e6-83f8-f119e1dc44f8" returned: 0 in 0.452s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:11 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-406a0cac-d7a7-42e6-83f8-f119e1dc44f8" released by "_delete_snapshot" :: held 2.064s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.782s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.363s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f36b1b93c40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T16:47:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-207352866',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd29d03-d9f5-4574-9444-c339f76ef6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697c445fd1e94c7b9674d545f20e6660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T16:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T16:47:03Z,use_quota=True,user_id='03d72e42fe264736aec8c15355fbba39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56cae889-407b-4f88-a5a9-d2c4efe0897d),volume_type_id=56cae889-407b-4f88-a5a9-d2c4efe0897d)}" {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Creating volume 7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Selected osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba as target Quobyte volume. {{(pid=82268) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 18:47:12 devstack cinder-volume[82268]: INFO cinder.volume.drivers.remotefs [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] casted to osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 1073741824 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b18b9b-a3b7-42bc-885b-59b89e022608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5', 'volume_size': 1, 'source_volid': '8784f8af-73fe-4a77-8559-55390ea12cb8', 'source_volstatus': 'available'}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489eab93-2ad7-461c-9c0e-e02289676e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:12 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 1073741824
Apr 20 18:47:12 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:12 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Volume volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 (03284bd6-5ec0-4b19-8d6b-e10e3ac098d5): created successfully
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489eab93-2ad7-461c-9c0e-e02289676e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Flow 'volume_create_manager' (df82a682-1f1a-4664-97b2-b638ab995260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:47:12 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-49fde7e4-e494-4a2f-b491-58f9c1c94fe0 tempest-VolumeDependencyTests-1447693068 None] Created volume successfully.
Apr 20 18:47:12 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 1073741824" returned: 0 in 0.479s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:12 devstack sudo[90730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1
Apr 20 18:47:12 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-8784f8af-73fe-4a77-8559-55390ea12cb8-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-8784f8af-73fe-4a77-8559-55390ea12cb8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-8784f8af-73fe-4a77-8559-55390ea12cb8" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-8784f8af-73fe-4a77-8559-55390ea12cb8" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1170e0-2831-4c56-bc88-483f00d2e245]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:12 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:12 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:12 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:13 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1" returned: 0 in 0.460s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'} {{(pid=82268) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a931fc7-c5ce-44c4-8910-64e1aca3afdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1', 'volume_size': 1}' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58fb161-9dd6-40a0-a552-4614e47ab750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 18:47:13 devstack cinder-volume[82268]: INFO cinder.volume.flows.manager.create_volume [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Volume volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 (7cd29d03-d9f5-4574-9444-c339f76ef6c1): created successfully
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c58fb161-9dd6-40a0-a552-4614e47ab750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82268) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Flow 'volume_create_manager' (f664ead8-7cba-4a67-8fe8-39ebf277eae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82268) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 18:47:13 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-07ca86ce-d97c-4e92-b773-16792ddf986f tempest-CinderUnicodeTest-1219430305 None] Created volume successfully.
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Creating offline snapshot 68b59107-fb3e-4710-8612-405c975c309c of volume 7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2991f2f-c84a-4fa3-87c9-e2f2270a3fec]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:13 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.560s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:13 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8
Apr 20 18:47:13 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:13 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1
Apr 20 18:47:13 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:13 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-8784f8af-73fe-4a77-8559-55390ea12cb8" returned: 0 in 0.502s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-8784f8af-73fe-4a77-8559-55390ea12cb8" released by "delete_volume" :: held 1.089s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Created reservations ['739d21b3-966a-4687-92c0-7881bf34fc63', '3266db55-b75f-4c7b-b0de-2758e734c71e', '0fddab8b-edf1-479f-b7b0-1de9d6dbfc1f', '470c50b6-b370-4bfa-822b-e6c1ba96dfcc'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:13 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1" returned: 0 in 0.613s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c 1G {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:13 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:13 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c 1G
Apr 20 18:47:13 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:14 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:14 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:14 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.481s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:14 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Deleted volume successfully.
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-077b6193-7980-4534-912f-457e579fd283 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-8784f8af-73fe-4a77-8559-55390ea12cb8-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:14 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c 1G" returned: 0 in 0.523s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:14 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c
Apr 20 18:47:14 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:14 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 -F qcow2 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c" returned: 0 in 0.444s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:14 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c is being set with open permissions: ugo+rw
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:14 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c
Apr 20 18:47:14 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" acquired by "delete_volume" :: waited 0.007s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[e401a67a-fc79-483a-8bf9-a2a39490c461]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:14 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:15 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5
Apr 20 18:47:15 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:15 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c" returned: 0 in 0.432s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:15 devstack sudo[90769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info
Apr 20 18:47:15 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:15 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" returned: 0 in 0.476s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:15 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5
Apr 20 18:47:15 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:15 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info" returned: 0 in 0.399s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:15 devstack cinder-volume[82268]: WARNING cinder.volume.drivers.remotefs [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info is being set with open permissions: ugo+rw
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:15 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info
Apr 20 18:47:15 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:15 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" returned: 0 in 0.403s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5" released by "delete_volume" :: held 0.900s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Created reservations ['8c0ddefb-2063-4b4f-9b49-bfef44adddf4', 'a8014e4b-e312-4dff-99d2-ac899cea42c1', '28b9c2fe-05f4-42f3-9da1-92198adcc659', '0658474c-b781-4aeb-9fd0-dfe09d887624'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:15 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:15 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:15 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-df855e6c-6d02-43f8-9bec-2602a156d759-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-df855e6c-6d02-43f8-9bec-2602a156d759-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "cinder-quobyte-df855e6c-6d02-43f8-9bec-2602a156d759" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-df855e6c-6d02-43f8-9bec-2602a156d759" acquired by "delete_volume" :: waited 0.021s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5facc308-e51b-4f16-b3f1-9236d7ad07ee]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:16 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759
Apr 20 18:47:16 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:16 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.info" returned: 0 in 0.456s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-053fb65e-a7f2-4685-8ed5-13ec93fcad5e tempest-CinderUnicodeTest-1219430305 None] Create snapshot completed successfully
Apr 20 18:47:16 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.454s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:16 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Deleted volume successfully.
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-6db871d0-5e2f-4236-89df-cf8fb8f96a82 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-03284bd6-5ec0-4b19-8d6b-e10e3ac098d5-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-68b59107-fb3e-4710-8612-405c975c309c-delete_snapshot" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-68b59107-fb3e-4710-8612-405c975c309c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-quobyte-7cd29d03-d9f5-4574-9444-c339f76ef6c1" by "delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-7cd29d03-d9f5-4574-9444-c339f76ef6c1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-quobyte-68b59107-fb3e-4710-8612-405c975c309c" by "_delete_snapshot" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-68b59107-fb3e-4710-8612-405c975c309c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Deleting offline snapshot 68b59107-fb3e-4710-8612-405c975c309c of volume 7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] snapshot_file for this snap is: volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c {{(pid=82268) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[403a1788-a188-4a41-a45e-3f1938f7726f]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:16 devstack sudo[90783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c
Apr 20 18:47:16 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:16 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759" returned: 0 in 0.500s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:16 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759
Apr 20 18:47:16 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:16 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c" returned: 0 in 0.479s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:16 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.remotefs [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82268) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa19bbe-e3e1-43c8-b2af-dc91b92d26b0]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:17 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-df855e6c-6d02-43f8-9bec-2602a156d759" returned: 0 in 0.409s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-quobyte-df855e6c-6d02-43f8-9bec-2602a156d759" released by "delete_volume" :: held 0.930s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:17 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1
Apr 20 18:47:17 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Created reservations ['4cf73026-e22d-411e-9485-97679b538a78', '9f8b37bf-ee81-4467-ac23-644e74bcf0be', 'cf28ce68-5db6-4d54-8dba-8e231cfdb9af', 'bab95e4b-15d4-468c-84d6-eb565a24da67'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:17 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:17 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:17 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1" returned: 0 in 0.531s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:17 devstack sudo[90802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c
Apr 20 18:47:17 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:17 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.483s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:17 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Deleted volume successfully.
Apr 20 18:47:17 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-fe1f2bda-a71c-467e-9f4d-e798bd642050 tempest-VolumeDependencyTests-1447693068 None] Lock "cinder-df855e6c-6d02-43f8-9bec-2602a156d759-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:18 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c" returned: 0 in 0.546s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:18 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c
Apr 20 18:47:18 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:18 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1.68b59107-fb3e-4710-8612-405c975c309c" returned: 0 in 0.411s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-68b59107-fb3e-4710-8612-405c975c309c" released by "_delete_snapshot" :: held 2.020s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-7cd29d03-d9f5-4574-9444-c339f76ef6c1" released by "delete_snapshot" :: held 2.033s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Created reservations ['824c8216-1bac-4918-9d63-fd9411ca8171', '28c0c243-c4ff-4faf-9680-f063096f0144', '90758b5d-b72b-4eae-a5b6-137a68ffd8c1', '29a48605-94d9-45ed-80ce-44957ac1d761'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:18 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Delete snapshot completed successfully.
Apr 20 18:47:18 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-149d7554-c825-4e79-bbe1-63eaa6d13d77 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-68b59107-fb3e-4710-8612-405c975c309c-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-7cd29d03-d9f5-4574-9444-c339f76ef6c1-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-7cd29d03-d9f5-4574-9444-c339f76ef6c1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-quobyte-7cd29d03-d9f5-4574-9444-c339f76ef6c1" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:19 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-7cd29d03-d9f5-4574-9444-c339f76ef6c1" acquired by "delete_volume" :: waited 0.013s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:19 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4acc7-79b7-464d-9fb3-889df6412cf3]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:19 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:19 devstack sudo[90845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1
Apr 20 18:47:19 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:20 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1" returned: 0 in 0.464s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:20 devstack sudo[90850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1
Apr 20 18:47:20 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:20 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-7cd29d03-d9f5-4574-9444-c339f76ef6c1" returned: 0 in 0.404s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-7cd29d03-d9f5-4574-9444-c339f76ef6c1" released by "delete_volume" :: held 0.901s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Created reservations ['18775e04-d823-4bb5-a06b-7b11c4ae4a36', 'da1bf187-9ce8-4a5a-8098-1eb9c53f3fbb', '4da754fe-febc-4a86-91a5-c27f97a45578', '3d1a06c8-c48d-46f2-a6ce-0309f3202b6f'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:20 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:20 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-2869dc7d-841b-418e-96f0-4a31a0ff1525-delete_volume" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-2869dc7d-841b-418e-96f0-4a31a0ff1525-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "cinder-quobyte-2869dc7d-841b-418e-96f0-4a31a0ff1525" by "delete_volume" {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-2869dc7d-841b-418e-96f0-4a31a0ff1525" acquired by "delete_volume" :: waited 0.008s {{(pid=82268) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d463bdd-c75c-4229-87f2-b12647f5bc26]: (4, 'qcow2') {{(pid=83069) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 18:47:20 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:20 devstack sudo[90856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525
Apr 20 18:47:20 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:21 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.431s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:21 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Deleted volume successfully.
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-8893bef9-b321-4a1d-ba7d-96ea2791dc53 tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-7cd29d03-d9f5-4574-9444-c339f76ef6c1-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:21 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525" returned: 0 in 0.466s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525 {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:21 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525
Apr 20 18:47:21 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:21 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad/volume-2869dc7d-841b-418e-96f0-4a31a0ff1525" returned: 0 in 0.407s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-quobyte-2869dc7d-841b-418e-96f0-4a31a0ff1525" released by "delete_volume" :: held 0.898s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG cinder.quota [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Created reservations ['ebdcc975-98cc-4c3e-865d-8849c9b55e06', 'e960d974-6141-43d8-aa99-8d5ca3b7c30d', '9e541e9e-2338-41aa-a5b6-5cc859800b43', '8a75548e-3636-49e2-8979-e977cb749c58'] {{(pid=82268) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba': None} {{(pid=82268) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG cinder.volume.drivers.quobyte [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-159f06e8-ea22-437d-b7fb-c6240c011cba'] {{(pid=82268) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.lockutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82268) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 18:47:21 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 18:47:21 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad
Apr 20 18:47:21 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 18:47:22 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 20 18:47:22 devstack cinder-volume[82268]: DEBUG oslo_concurrency.processutils [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/507de6dfe7b0594eb5bd4c6fd43e45ad" returned: 0 in 0.443s {{(pid=82268) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 18:47:22 devstack cinder-volume[82268]: DEBUG cinder.manager [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Notifying Schedulers of capabilities ... {{(pid=82268) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 18:47:22 devstack cinder-volume[82268]: INFO cinder.volume.manager [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Deleted volume successfully.
Apr 20 18:47:22 devstack cinder-volume[82268]: DEBUG cinder.coordination [None req-3ee36d9c-95cc-4909-a3ea-5100b1f00bbc tempest-CinderUnicodeTest-1219430305 None] Lock "cinder-2869dc7d-841b-418e-96f0-4a31a0ff1525-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82268) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 18:47:31 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:UPDATE=145,cinder:SELECT=90,cinder:DELETE=8,cinder:INSERT=36 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 18:47:32 devstack cinder-volume[82268]: DEBUG dbcounter [-] [82268] Writing DB stats cinder:SELECT=85,cinder:INSERT=31,cinder:UPDATE=116,cinder:DELETE=11 {{(pid=82268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}